Jul 27 12:33:18 user nova-compute[70994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 27 12:33:20 user nova-compute[70994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70994) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 12:33:20 user nova-compute[70994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70994) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 12:33:20 user nova-compute[70994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70994) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 12:33:20 user nova-compute[70994]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:33:21 user nova-compute[70994]: INFO nova.virt.driver [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 27 12:33:21 user nova-compute[70994]: INFO nova.compute.provider_config [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Acquiring lock "singleton_lock" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Acquired lock "singleton_lock" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Releasing lock "singleton_lock" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Full set of CONF: {{(pid=70994) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ******************************************************************************** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Configuration options gathered from: {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ================================================================================ {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] allow_resize_to_same_host      = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] arq_binding_timeout            = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] backdoor_port                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] backdoor_socket                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] block_device_allocate_retries  = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] block_device_allocate_retries_interval = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cert                           = self.pem {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute_monitors               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] config_dir                     = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] config_drive_format            = iso9660 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] config_source                  = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] console_host                   = user {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] control_exchange               = nova {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cpu_allocation_ratio           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] daemon                         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] debug                          = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] default_access_ip_network_name = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] default_availability_zone      = nova {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] default_ephemeral_format       = ext4 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] default_schedule_zone          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] disk_allocation_ratio          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] enable_new_services            = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] enabled_ssl_apis               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] flat_injected                  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] force_config_drive             = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] force_raw_images               = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] graceful_shutdown_timeout      = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] heal_instance_info_cache_interval = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] host                           = user {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_build_timeout         = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_delete_interval       = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_name_template         = instance-%08x {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_usage_audit           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_usage_audit_period    = month {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] internal_service_availability_zone = internal {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] key                            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] live_migration_retry_count     = 30 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_config_append              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_dir                        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_file                       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_options                    = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_rotate_interval            = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_rotate_interval_type       = days {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] log_rotation_type              = none {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] long_rpc_timeout               = 1800 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_concurrent_builds          = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_concurrent_live_migrations = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_concurrent_snapshots       = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_local_block_devices        = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_logfile_count              = 30 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] max_logfile_size_mb            = 200 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] maximum_instance_delete_attempts = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metadata_listen                = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metadata_listen_port           = 8775 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metadata_workers               = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] migrate_max_retries            = -1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] mkisofs_cmd                    = genisoimage {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] my_ip                          = 10.0.0.210 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] network_allocate_retries       = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] osapi_compute_listen_port      = 8774 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] osapi_compute_unique_server_name_scope =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] osapi_compute_workers          = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] password_length                = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] periodic_enable                = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] periodic_fuzzy_delay           = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] pointer_model                  = ps2mouse {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] preallocate_images             = none {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] publish_errors                 = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] pybasedir                      = /opt/stack/nova {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ram_allocation_ratio           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rate_limit_burst               = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rate_limit_except_level        = CRITICAL {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rate_limit_interval            = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reboot_timeout                 = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reclaim_instance_interval      = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] record                         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reimage_timeout_per_gb         = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] report_interval                = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rescue_timeout                 = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reserved_host_cpus             = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reserved_host_disk_mb          = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reserved_host_memory_mb        = 512 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] reserved_huge_pages            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] resize_confirm_window          = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] resize_fs_using_block_device   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] resume_guests_state_on_host_boot = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rpc_response_timeout           = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] run_external_periodic_tasks    = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] running_deleted_instance_action = reap {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] running_deleted_instance_timeout = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler_instance_sync_interval = 120 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_down_time              = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] servicegroup_driver            = db {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] shelved_offload_time           = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] shelved_poll_interval          = 3600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] shutdown_timeout               = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] source_is_ipv6                 = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ssl_only                       = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] state_path                     = /opt/stack/data/nova {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] sync_power_state_interval      = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] sync_power_state_pool_size     = 1000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] syslog_log_facility            = LOG_USER {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] tempdir                        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] timeout_nbd                    = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] transport_url                  = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] update_resources_interval      = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_cow_images                 = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_eventlog                   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_journal                    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_json                       = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_rootwrap_daemon            = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_stderr                     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] use_syslog                     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vcpu_pin_set                   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plugging_is_fatal          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plugging_timeout           = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] virt_mkfs                      = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] volume_usage_poll_interval     = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] watch_log_file                 = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] web                            = /usr/share/spice-html5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_concurrency.disable_process_locking = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.auth_strategy              = keystone {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.compute_link_prefix        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.dhcp_domain                = novalocal {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.enable_instance_password   = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.glance_link_prefix         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.instance_list_per_project_cells = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.list_records_by_skipping_down_cells = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.local_metadata_per_cell    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.max_limit                  = 1000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.metadata_cache_expiration  = 15 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.neutron_default_tenant_id  = default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.use_forwarded_for          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.use_neutron_default_nets   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_dynamic_targets = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_jsonfile_path   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.backend_argument         = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.config_prefix            = cache.oslo {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.dead_timeout             = 60.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.debug_cache_backend      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.enable_retry_client      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.enable_socket_keepalive  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.enabled                  = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.expiration_time          = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.hashclient_retry_attempts = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_dead_retry      = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_password        =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_sasl_enabled    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.memcache_username        =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.proxies                  = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.retry_attempts           = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.retry_delay              = 0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.socket_keepalive_count   = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.socket_keepalive_idle    = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.socket_keepalive_interval = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.tls_allowed_ciphers      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.tls_cafile               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.tls_certfile             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.tls_enabled              = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cache.tls_keyfile              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.auth_section            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.auth_type               = password {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.cafile                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.certfile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.collect_timing          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.cross_az_attach         = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.debug                   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.endpoint_template       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.http_retries            = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.insecure                = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.keyfile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.os_region_name          = RegionOne {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.split_loggers           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cinder.timeout                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.cpu_dedicated_set      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.cpu_shared_set         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.image_type_exclude_list = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.resource_provider_association_refresh = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.shutdown_retry_interval = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] conductor.workers              = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] console.allowed_origins        = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] console.ssl_ciphers            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] console.ssl_minimum_version    = default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] consoleauth.token_ttl          = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.cafile                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.certfile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.collect_timing          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.connect_retries         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.connect_retry_delay     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.endpoint_override       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.insecure                = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.keyfile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.max_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.min_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.region_name             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.service_name            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.service_type            = accelerator {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.split_loggers           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.status_code_retries     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.timeout                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] cyborg.version                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.backend               = sqlalchemy {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.connection            = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.connection_debug      = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.connection_parameters =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.connection_recycle_time = 3600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.connection_trace      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.db_inc_retry_interval = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.db_max_retries        = 20 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.db_max_retry_interval = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.db_retry_interval     = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.max_overflow          = 50 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.max_pool_size         = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.max_retries           = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.mysql_enable_ndb      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.mysql_wsrep_sync_wait = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.pool_timeout          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.retry_interval        = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.slave_connection      = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] database.sqlite_synchronous    = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.backend           = sqlalchemy {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.connection        = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.connection_debug  = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.connection_parameters =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.connection_recycle_time = 3600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.connection_trace  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.db_inc_retry_interval = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.db_max_retries    = 20 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.db_max_retry_interval = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.db_retry_interval = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.max_overflow      = 50 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.max_pool_size     = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.max_retries       = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.mysql_enable_ndb  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.pool_timeout      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.retry_interval    = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.slave_connection  = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] api_database.sqlite_synchronous = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] devices.enabled_mdev_types     = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ephemeral_storage_encryption.enabled = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.api_servers             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.cafile                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.certfile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.collect_timing          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.connect_retries         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.connect_retry_delay     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.debug                   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.default_trusted_certificate_ids = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.enable_certificate_validation = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.enable_rbd_download     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.endpoint_override       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.insecure                = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.keyfile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.max_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.min_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.num_retries             = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.rbd_ceph_conf           =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.rbd_connect_timeout     = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.rbd_pool                =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.rbd_user                =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.region_name             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.service_name            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.service_type            = image {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.split_loggers           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.status_code_retries     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.timeout                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.verify_glance_signatures = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] glance.version                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] guestfs.debug                  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.config_drive_cdrom      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.config_drive_inject_password = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.enable_remotefx         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.instances_path_share    =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.limit_cpu_features      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.use_multipath_io        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.vswitch_name            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] mks.enabled                    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.manager_interval   = 2400 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.precache_concurrency = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.remove_unused_base_images = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] image_cache.subdirectory_name  = _base {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.api_max_retries         = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.api_retry_interval      = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.auth_section            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.auth_type               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.cafile                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.certfile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.collect_timing          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.connect_retries         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.connect_retry_delay     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.endpoint_override       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.insecure                = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.keyfile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.max_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.min_version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.partition_key           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.peer_list               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.region_name             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.serial_console_state_timeout = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.service_name            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.service_type            = baremetal {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.split_loggers           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.status_code_retries     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.timeout                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ironic.version                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] key_manager.fixed_key          = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.barbican_api_version  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.barbican_endpoint     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.barbican_endpoint_type = public {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.barbican_region_name  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.cafile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.certfile              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.collect_timing        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.insecure              = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.keyfile               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.number_of_retries     = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.retry_delay           = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.send_service_user_token = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.split_loggers         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.timeout               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.verify_ssl            = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican.verify_ssl_path       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.auth_section = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.auth_type = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.cafile   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.certfile = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.collect_timing = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.insecure = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.keyfile  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.split_loggers = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] barbican_service_user.timeout  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.approle_role_id          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.approle_secret_id        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.cafile                   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.certfile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.collect_timing           = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.insecure                 = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.keyfile                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.kv_mountpoint            = secret {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.kv_version               = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.namespace                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.root_token_id            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.split_loggers            = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.ssl_ca_crt_file          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.timeout                  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.use_ssl                  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.cafile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.certfile              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.collect_timing        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.connect_retries       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.connect_retry_delay   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.endpoint_override     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.insecure              = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.keyfile               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.max_version           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.min_version           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.region_name           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.service_name          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.service_type          = identity {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.split_loggers         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.status_code_retries   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.timeout               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] keystone.version               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.connection_uri         =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_mode               = custom {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: WARNING oslo_config.cfg [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_power_governor_high = performance {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_power_management   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.device_detach_attempts = 8 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.device_detach_timeout  = 20 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.disk_cachemodes        = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.disk_prefix            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.enabled_perf_events    = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.file_backed_memory     = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.gid_maps               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.hw_disk_discard        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.hw_machine_type        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_rbd_pool        = rbd {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_type            = default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.images_volume_group    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.inject_key             = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.inject_partition       = -2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.inject_password        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.iscsi_iface            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.iser_use_multipath     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_downtime = 500 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_inbound_addr = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_scheme  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_timeout_action = abort {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_tunnelled = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: WARNING oslo_config.cfg [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 27 12:33:21 user nova-compute[70994]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 27 12:33:21 user nova-compute[70994]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 27 12:33:21 user nova-compute[70994]: and ``live_migration_inbound_addr`` respectively.
Jul 27 12:33:21 user nova-compute[70994]: ).  Its value may be silently ignored in the future.
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.live_migration_with_native_tls = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.max_queues             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.nfs_mount_options      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_pcie_ports         = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.pmem_namespaces        = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.quobyte_client_cfg     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rbd_secret_uuid        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rbd_user               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rescue_image_id        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rescue_kernel_id       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.rx_queue_size          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.smbfs_mount_options    =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.snapshot_compression   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.snapshot_image_format  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.sparse_logical_volumes = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.swtpm_enabled          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.swtpm_group            = tss {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.swtpm_user             = tss {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.sysinfo_serial         = unique {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.tb_cache_size          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.tx_queue_size          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.uid_maps               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.use_virtio_for_bridges = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.virt_type              = kvm {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.volume_clear           = zero {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.volume_clear_size      = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.volume_use_multipath   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_cache_path   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.auth_section           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.auth_type              = password {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.cafile                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.certfile               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.collect_timing         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.connect_retries        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.connect_retry_delay    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.default_floating_pool  = public {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.endpoint_override      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.extension_sync_interval = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.http_retries           = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.insecure               = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.keyfile                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.max_version            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.min_version            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.ovs_bridge             = br-int {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.physnets               = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.region_name            = RegionOne {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.service_metadata_proxy = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.service_name           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.service_type           = network {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.split_loggers          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.status_code_retries    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.timeout                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] neutron.version                = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] notifications.bdms_in_notifications = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] notifications.default_level    = INFO {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] notifications.notification_format = unversioned {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] notifications.notify_on_state_change = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] pci.alias                      = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] pci.device_spec                = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] pci.report_in_placement        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.auth_section         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.auth_type            = password {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.cafile               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.certfile             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.collect_timing       = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.connect_retries      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.connect_retry_delay  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.default_domain_id    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.default_domain_name  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.domain_id            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.domain_name          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.endpoint_override    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.insecure             = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.keyfile              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.max_version          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.min_version          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.password             = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.project_domain_id    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.project_domain_name  = Default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.project_id           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.project_name         = service {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.region_name          = RegionOne {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.service_name         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.service_type         = placement {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.split_loggers        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.status_code_retries  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.system_scope         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.timeout              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.trust_id             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.user_domain_id       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.user_domain_name     = Default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.user_id              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.username             = placement {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] placement.version              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.cores                    = 20 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.count_usage_from_placement = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.injected_file_content_bytes = 10240 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.injected_file_path_length = 255 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.injected_files           = 5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.instances                = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.key_pairs                = 100 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.metadata_items           = 128 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.ram                      = 51200 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.recheck_quota            = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.server_group_members     = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] quota.server_groups            = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rdp.enabled                    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.image_metadata_prefilter = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.max_attempts         = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.max_placement_results = 1000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] scheduler.workers              = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.host_subset_size = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.isolated_hosts = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.isolated_images = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.pci_in_placement = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.track_instance_changes = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metrics.required               = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metrics.weight_multiplier      = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] metrics.weight_setting         = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.enabled         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.port_range      = 10000:20000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] serial_console.serialproxy_port = 6083 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.auth_section      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.auth_type         = password {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.cafile            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.certfile          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.collect_timing    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.insecure          = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.keyfile           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.send_service_user_token = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.split_loggers     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] service_user.timeout           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.agent_enabled            = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.enabled                  = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.html5proxy_port          = 6082 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.image_compression        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.jpeg_compression         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.playback_compression     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.server_listen            = 127.0.0.1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.streaming_mode           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] spice.zlib_compression         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] upgrade_levels.baseapi         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] upgrade_levels.cert            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] upgrade_levels.compute         = auto {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] upgrade_levels.conductor       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] upgrade_levels.scheduler       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.cafile = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.certfile = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.insecure = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vendordata_dynamic_auth.timeout = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.api_retry_count         = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.ca_file                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.cache_prefix            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.cluster_name            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.connection_pool_size    = 10 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.console_delay_seconds   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.datastore_regex         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.host_ip                 = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.host_password           = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.host_port               = 443 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.host_username           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.insecure                = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.integration_bridge      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.maximum_objects         = 100 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.pbm_default_policy      = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.pbm_enabled             = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.pbm_wsdl_location       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.serial_port_proxy_uri   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.serial_port_service_uri = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.task_poll_interval      = 0.5 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.use_linked_clone        = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.vnc_keymap              = en-us {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.vnc_port                = 5900 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vmware.vnc_port_total          = 10000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.auth_schemes               = ['none'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.enabled                    = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.novncproxy_port            = 6080 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.vencrypt_ca_certs          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.vencrypt_client_cert       = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vnc.vencrypt_client_key        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.disable_rootwrap   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.enable_numa_live_migration = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.libvirt_disable_apic = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.client_socket_timeout     = 900 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.default_pool_size         = 1000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.keep_alive                = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.max_header_line           = 16384 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.ssl_ca_file               = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.ssl_cert_file             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.ssl_key_file              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.tcp_keepidle              = 600 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] zvm.ca_file                    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] zvm.cloud_connector_url        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] zvm.reachable_timeout          = 300 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.enforce_new_defaults = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.enforce_scope      = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.policy_default_rule = default {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.connection_string     = messaging:// {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.enabled               = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.es_doc_type           = notification {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.es_scroll_size        = 10000 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.es_scroll_time        = 2m {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.filter_error_trace    = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.hmac_keys             = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.sentinel_service_name = mymaster {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.socket_timeout        = 0.1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.trace_requests        = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler.trace_sqlalchemy      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler_jaeger.process_tags   = {} {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler_jaeger.service_name_prefix = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] profiler_otlp.service_name_prefix = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] remote_debug.host              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] remote_debug.port              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_notifications.retry = -1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.auth_section        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.auth_type           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.cafile              = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.certfile            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.collect_timing      = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.connect_retries     = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.connect_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.endpoint_id         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.endpoint_override   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.insecure            = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.keyfile             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.max_version         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.min_version         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.region_name         = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.service_name        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.service_type        = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.split_loggers       = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.status_code_retries = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.status_code_retry_delay = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.timeout             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.valid_interfaces    = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_limit.version             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_reports.file_event_handler = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] oslo_reports.log_dir           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.group  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] vif_plug_ovs_privileged.user   = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.isolate_vif         = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] os_brick.lock_path             = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.capabilities   = [21] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.group          = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.helper_command = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] privsep_osbrick.user           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.group           = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.helper_command  = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] nova_sys_admin.user            = None {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG oslo_service.service [None req-97bd5e58-b6c0-4c25-97cf-452e3bfe4168 None None] ******************************************************************************** {{(pid=70994) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 27 12:33:21 user nova-compute[70994]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Starting native event thread {{(pid=70994) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Starting green dispatch thread {{(pid=70994) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Starting connection event dispatch thread {{(pid=70994) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Connecting to libvirt: qemu:///system {{(pid=70994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f88fe7bb7c0> {{(pid=70994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f88fe7bb7c0> {{(pid=70994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 27 12:33:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Connection event '1' reason 'None'
Jul 27 12:33:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 12:33:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.mount [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Initialising _HostMountState generation 0 {{(pid=70994) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 27 12:33:28 user nova-compute[70994]: INFO nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host capabilities <capabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <host>
Jul 27 12:33:28 user nova-compute[70994]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 27 12:33:28 user nova-compute[70994]:     <cpu>
Jul 27 12:33:28 user nova-compute[70994]:       <arch>x86_64</arch>
Jul 27 12:33:28 user nova-compute[70994]:       <model>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <microcode version='1070'/>
Jul 27 12:33:28 user nova-compute[70994]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='osxsave'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='invtsc'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='rsba'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature name='skip-l1dfl-vmentry'/>
Jul 27 12:33:28 user nova-compute[70994]:       <pages unit='KiB' size='4'/>
Jul 27 12:33:28 user nova-compute[70994]:       <pages unit='KiB' size='2048'/>
Jul 27 12:33:28 user nova-compute[70994]:     </cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <power_management>
Jul 27 12:33:28 user nova-compute[70994]:       <suspend_mem/>
Jul 27 12:33:28 user nova-compute[70994]:       <suspend_disk/>
Jul 27 12:33:28 user nova-compute[70994]:       <suspend_hybrid/>
Jul 27 12:33:28 user nova-compute[70994]:     </power_management>
Jul 27 12:33:28 user nova-compute[70994]:     <iommu support='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <migration_features>
Jul 27 12:33:28 user nova-compute[70994]:       <live/>
Jul 27 12:33:28 user nova-compute[70994]:       <uri_transports>
Jul 27 12:33:28 user nova-compute[70994]:         <uri_transport>tcp</uri_transport>
Jul 27 12:33:28 user nova-compute[70994]:         <uri_transport>rdma</uri_transport>
Jul 27 12:33:28 user nova-compute[70994]:       </uri_transports>
Jul 27 12:33:28 user nova-compute[70994]:     </migration_features>
Jul 27 12:33:28 user nova-compute[70994]:     <topology>
Jul 27 12:33:28 user nova-compute[70994]:       <cells num='2'>
Jul 27 12:33:28 user nova-compute[70994]:         <cell id='0'>
Jul 27 12:33:28 user nova-compute[70994]:           <memory unit='KiB'>8140616</memory>
Jul 27 12:33:28 user nova-compute[70994]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 27 12:33:28 user nova-compute[70994]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 12:33:28 user nova-compute[70994]:           <distances>
Jul 27 12:33:28 user nova-compute[70994]:             <sibling id='0' value='10'/>
Jul 27 12:33:28 user nova-compute[70994]:             <sibling id='1' value='20'/>
Jul 27 12:33:28 user nova-compute[70994]:           </distances>
Jul 27 12:33:28 user nova-compute[70994]:           <cpus num='6'>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 27 12:33:28 user nova-compute[70994]:           </cpus>
Jul 27 12:33:28 user nova-compute[70994]:         </cell>
Jul 27 12:33:28 user nova-compute[70994]:         <cell id='1'>
Jul 27 12:33:28 user nova-compute[70994]:           <memory unit='KiB'>8255068</memory>
Jul 27 12:33:28 user nova-compute[70994]:           <pages unit='KiB' size='4'>2063767</pages>
Jul 27 12:33:28 user nova-compute[70994]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 12:33:28 user nova-compute[70994]:           <distances>
Jul 27 12:33:28 user nova-compute[70994]:             <sibling id='0' value='20'/>
Jul 27 12:33:28 user nova-compute[70994]:             <sibling id='1' value='10'/>
Jul 27 12:33:28 user nova-compute[70994]:           </distances>
Jul 27 12:33:28 user nova-compute[70994]:           <cpus num='6'>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 27 12:33:28 user nova-compute[70994]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 27 12:33:28 user nova-compute[70994]:           </cpus>
Jul 27 12:33:28 user nova-compute[70994]:         </cell>
Jul 27 12:33:28 user nova-compute[70994]:       </cells>
Jul 27 12:33:28 user nova-compute[70994]:     </topology>
Jul 27 12:33:28 user nova-compute[70994]:     <cache>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 27 12:33:28 user nova-compute[70994]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 27 12:33:28 user nova-compute[70994]:     </cache>
Jul 27 12:33:28 user nova-compute[70994]:     <secmodel>
Jul 27 12:33:28 user nova-compute[70994]:       <model>apparmor</model>
Jul 27 12:33:28 user nova-compute[70994]:       <doi>0</doi>
Jul 27 12:33:28 user nova-compute[70994]:     </secmodel>
Jul 27 12:33:28 user nova-compute[70994]:     <secmodel>
Jul 27 12:33:28 user nova-compute[70994]:       <model>dac</model>
Jul 27 12:33:28 user nova-compute[70994]:       <doi>0</doi>
Jul 27 12:33:28 user nova-compute[70994]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 27 12:33:28 user nova-compute[70994]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 27 12:33:28 user nova-compute[70994]:     </secmodel>
Jul 27 12:33:28 user nova-compute[70994]:   </host>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='alpha'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>clipper</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='armv6l'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>spitz</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>nuri</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>kzm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>z2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>tosa</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n810</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>terrier</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>midway</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>microbit</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>verdex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>highbank</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>akita</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>connex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>collie</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='armv7l'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>spitz</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>nuri</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>kzm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>z2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>tosa</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n810</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>terrier</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>midway</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>microbit</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>verdex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>highbank</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>akita</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>connex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>collie</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='aarch64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>spitz</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>nuri</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>kzm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>z2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>tosa</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n810</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>n800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>terrier</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>midway</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>microbit</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>verdex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>raspi3b</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>highbank</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>akita</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>connex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>collie</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <acpi default='on' toggle='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='cris'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='i686'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>isapc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>microvm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='kvm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <pae/>
Jul 27 12:33:28 user nova-compute[70994]:       <nonpae/>
Jul 27 12:33:28 user nova-compute[70994]:       <acpi default='on' toggle='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:       <apic default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='m68k'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>an5206</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>q800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>next-cube</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='microblaze'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='microblazeel'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='mips'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>malta</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='mipsel'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>malta</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='mips64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>malta</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>pica61</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>magnum</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='mips64el'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>malta</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>pica61</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>magnum</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='16'>boston</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='ppc'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mac99</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>40p</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>taihu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='ppc64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>taihu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>40p</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mac99</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='ppc64le'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>taihu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>40p</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>mac99</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='riscv32'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='8'>spike</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>opentitan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='8'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='riscv64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='8'>spike</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>shakti_c</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='8'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='s390x'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='sh4'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>shix</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>r2d</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='sh4eb'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>shix</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>r2d</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='sparc'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>SS-5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>SS-20</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>LX</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>SS-4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>SS-10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>Voyager</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='sparc64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sun4u</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>niagara</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>sun4v</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='x86_64'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>64</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='1'>isapc</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>microvm</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='kvm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <acpi default='on' toggle='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:       <apic default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='xtensa'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>sim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>kc705</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ml605</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx200</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx60</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]:   <guest>
Jul 27 12:33:28 user nova-compute[70994]:     <os_type>hvm</os_type>
Jul 27 12:33:28 user nova-compute[70994]:     <arch name='xtensaeb'>
Jul 27 12:33:28 user nova-compute[70994]:       <wordsize>32</wordsize>
Jul 27 12:33:28 user nova-compute[70994]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='4'>sim</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>kc705</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ml605</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>virt</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx200</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>lx60</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 12:33:28 user nova-compute[70994]:       <domain type='qemu'/>
Jul 27 12:33:28 user nova-compute[70994]:     </arch>
Jul 27 12:33:28 user nova-compute[70994]:     <features>
Jul 27 12:33:28 user nova-compute[70994]:       <cpuselection/>
Jul 27 12:33:28 user nova-compute[70994]:       <deviceboot/>
Jul 27 12:33:28 user nova-compute[70994]:       <disksnapshot default='on' toggle='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     </features>
Jul 27 12:33:28 user nova-compute[70994]:   </guest>
Jul 27 12:33:28 user nova-compute[70994]: </capabilities>
Jul 27 12:33:28 user nova-compute[70994]: 
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-i440fx-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>i686</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='255'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'/>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='lm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ide</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-q35-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>i686</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='288'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'/>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='lm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-i440fx-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>i686</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='255'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'/>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='lm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ide</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-q35-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>i686</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='288'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'/>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='lm'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-i440fx-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>x86_64</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='255'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>efi</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='invtsc'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='rsba'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ide</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-q35-jammy</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>x86_64</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='288'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>efi</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='invtsc'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='rsba'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-i440fx-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>x86_64</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='255'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>efi</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='invtsc'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='rsba'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ide</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 27 12:33:28 user nova-compute[70994]: <domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 12:33:28 user nova-compute[70994]:   <domain>kvm</domain>
Jul 27 12:33:28 user nova-compute[70994]:   <machine>pc-q35-6.2</machine>
Jul 27 12:33:28 user nova-compute[70994]:   <arch>x86_64</arch>
Jul 27 12:33:28 user nova-compute[70994]:   <vcpu max='288'/>
Jul 27 12:33:28 user nova-compute[70994]:   <iothreads supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:   <os supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='firmware'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>efi</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:     <loader supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>rom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pflash</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='readonly'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='secure'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>yes</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>no</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </loader>
Jul 27 12:33:28 user nova-compute[70994]:   </os>
Jul 27 12:33:28 user nova-compute[70994]:   <cpu>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-passthrough' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='hostPassthroughMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='maximum' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='maximumMigratable'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>on</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>off</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='host-model' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <vendor>Intel</vendor>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ss'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='vmx'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pcid'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='hypervisor'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arat'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='umip'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='md-clear'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='invtsc'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibpb'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='ibrs'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-stibp'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='rsba'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='erms'/>
Jul 27 12:33:28 user nova-compute[70994]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:     <mode name='custom' supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>qemu64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>qemu32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>phenom</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>pentium</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>n270</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm64</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>kvm32</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>coreduo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>core2duo</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>athlon</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Westmere</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Snowridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Skylake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>SandyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Penryn</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G5</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G4</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G3</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Opteron_G2</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Opteron_G1</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Nehalem</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>IvyBridge</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Icelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Haswell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Rome</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-Milan</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>EPYC</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Dhyana</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cooperlake</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>Conroe</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='no'>Broadwell</model>
Jul 27 12:33:28 user nova-compute[70994]:       <model usable='yes'>486</model>
Jul 27 12:33:28 user nova-compute[70994]:     </mode>
Jul 27 12:33:28 user nova-compute[70994]:   </cpu>
Jul 27 12:33:28 user nova-compute[70994]:   <memoryBacking supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:     <enum name='sourceType'>
Jul 27 12:33:28 user nova-compute[70994]:       <value>file</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>anonymous</value>
Jul 27 12:33:28 user nova-compute[70994]:       <value>memfd</value>
Jul 27 12:33:28 user nova-compute[70994]:     </enum>
Jul 27 12:33:28 user nova-compute[70994]:   </memoryBacking>
Jul 27 12:33:28 user nova-compute[70994]:   <devices>
Jul 27 12:33:28 user nova-compute[70994]:     <disk supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='diskDevice'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>disk</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cdrom</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>floppy</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>lun</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='bus'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>fdc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sata</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </disk>
Jul 27 12:33:28 user nova-compute[70994]:     <graphics supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='type'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>sdl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vnc</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>spice</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egl-headless</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </graphics>
Jul 27 12:33:28 user nova-compute[70994]:     <video supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='modelType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>cirrus</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>vmvga</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>qxl</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>none</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>bochs</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>ramfb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </video>
Jul 27 12:33:28 user nova-compute[70994]:     <hostdev supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='mode'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>subsystem</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='startupPolicy'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>default</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>mandatory</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>requisite</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>optional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='subsysType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>usb</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>pci</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>scsi</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='capsType'/>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='pciBackend'/>
Jul 27 12:33:28 user nova-compute[70994]:     </hostdev>
Jul 27 12:33:28 user nova-compute[70994]:     <rng supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtio-non-transitional</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>random</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>egd</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>builtin</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </rng>
Jul 27 12:33:28 user nova-compute[70994]:     <filesystem supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='driverType'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>path</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>handle</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>virtiofs</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </filesystem>
Jul 27 12:33:28 user nova-compute[70994]:     <tpm supported='yes'>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='model'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-tis</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>tpm-crb</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:       <enum name='backendModel'>
Jul 27 12:33:28 user nova-compute[70994]:         <value>passthrough</value>
Jul 27 12:33:28 user nova-compute[70994]:         <value>emulator</value>
Jul 27 12:33:28 user nova-compute[70994]:       </enum>
Jul 27 12:33:28 user nova-compute[70994]:     </tpm>
Jul 27 12:33:28 user nova-compute[70994]:   </devices>
Jul 27 12:33:28 user nova-compute[70994]:   <features>
Jul 27 12:33:28 user nova-compute[70994]:     <gic supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:     <vmcoreinfo supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <genid supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backingStoreInput supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <backup supported='yes'/>
Jul 27 12:33:28 user nova-compute[70994]:     <sev supported='no'/>
Jul 27 12:33:28 user nova-compute[70994]:   </features>
Jul 27 12:33:28 user nova-compute[70994]: </domainCapabilities>
Jul 27 12:33:28 user nova-compute[70994]:  {{(pid=70994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Checking secure boot support for host arch (x86_64) {{(pid=70994) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Checking secure boot support for host arch (x86_64) {{(pid=70994) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Checking secure boot support for host arch (x86_64) {{(pid=70994) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Secure Boot support detected
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] cpu compare xml: <cpu match="exact">
Jul 27 12:33:29 user nova-compute[70994]:   <model>Nehalem</model>
Jul 27 12:33:29 user nova-compute[70994]: </cpu>
Jul 27 12:33:29 user nova-compute[70994]:  {{(pid=70994) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.virt.node [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Generated node identity 171e9a47-00d8-4e90-9ceb-1b30c2928bd7
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.virt.node [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Wrote node identity 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 to /opt/stack/data/nova/compute_id
Jul 27 12:33:29 user nova-compute[70994]: WARNING nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Compute nodes ['171e9a47-00d8-4e90-9ceb-1b30c2928bd7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 27 12:33:29 user nova-compute[70994]: WARNING nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 12:33:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:33:29 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:33:29 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Hypervisor/Node resource view: name=user free_ram=10861MB free_disk=26.435226440429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:33:29 user nova-compute[70994]: WARNING nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] No compute node record for user:171e9a47-00d8-4e90-9ceb-1b30c2928bd7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 could not be found.
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Compute node record created for user:user with uuid: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [req-d72de749-d87b-48d6-9f66-4820ba783508] Created resource provider record via placement API for resource provider with UUID 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 and name user.
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70994) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 27 12:33:29 user nova-compute[70994]: INFO nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] kernel doesn't support AMD SEV
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Libvirt baseline CPU <cpu>
Jul 27 12:33:29 user nova-compute[70994]:   <arch>x86_64</arch>
Jul 27 12:33:29 user nova-compute[70994]:   <model>Nehalem</model>
Jul 27 12:33:29 user nova-compute[70994]:   <vendor>Intel</vendor>
Jul 27 12:33:29 user nova-compute[70994]:   <topology sockets="6" cores="1" threads="1"/>
Jul 27 12:33:29 user nova-compute[70994]: </cpu>
Jul 27 12:33:29 user nova-compute[70994]:  {{(pid=70994) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Updated inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Updating resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 generation from 0 to 1 during operation: update_inventory {{(pid=70994) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 12:33:29 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Updating resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 generation from 1 to 2 during operation: update_traits {{(pid=70994) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG nova.service [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Creating RPC server for service compute {{(pid=70994) start /opt/stack/nova/nova/service.py:182}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG nova.service [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Join ServiceGroup membership for this service compute {{(pid=70994) start /opt/stack/nova/nova/service.py:199}}
Jul 27 12:33:30 user nova-compute[70994]: DEBUG nova.servicegroup.drivers.db [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70994) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 27 12:34:02 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:02 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:34:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:34:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=10344MB free_disk=26.414962768554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:34:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:35:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:35:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:35:21 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=10281MB free_disk=26.404022216796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:35:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:35:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:36:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:36:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=26.331432342529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:36:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:36:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:36:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:37:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:37:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:37:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:37:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:37:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:37:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.29882049560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:37:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:37:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:37:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] There are 0 instances to clean {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 12:38:21 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:22 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:38:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:38:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:38:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:38:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:38:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.154544830322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:38:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:38:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:38:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:07 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:07 user nova-compute[70994]: INFO nova.compute.claims [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Claim successful on node user
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Refreshing inventories for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Updating ProviderTree inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Refreshing aggregate associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, aggregates: None {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Refreshing trait associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:08 user nova-compute[70994]: INFO nova.compute.claims [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Claim successful on node user
Jul 27 12:39:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Creating image(s)
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.policy [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f524fef921904389beb9e62ddd33512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c5028166444a07a4f9ccdc9206df91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.part --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.virt.images [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] 52d4c2ab-cf6e-46c3-b167-9a89ce78020a was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.part /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:09 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Creating image(s)
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "/opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "/opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.043s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:09 user nova-compute[70994]: DEBUG nova.policy [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d2b3b0a6c14b74a73370fda30251f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7fc676a5924df880ae87b91900fab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.part /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.converted" returned: 0 in 0.596s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.544s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:10 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzjd8dln1/privsep.sock']
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.691s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:10 user sudo[80255]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzjd8dln1/privsep.sock
Jul 27 12:39:10 user sudo[80255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:10 user nova-compute[70994]: INFO nova.compute.claims [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Claim successful on node user
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Creating image(s)
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:10 user nova-compute[70994]: DEBUG nova.policy [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d2b3b0a6c14b74a73370fda30251f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7fc676a5924df880ae87b91900fab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:11 user sudo[80255]: pam_unix(sudo:session): session closed for user root
Jul 27 12:39:11 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Spawned new privsep daemon via rootwrap
Jul 27 12:39:11 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 12:39:11 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 12:39:11 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 27 12:39:11 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80258
Jul 27 12:39:11 user nova-compute[70994]: WARNING oslo_privsep.priv_context [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] privsep daemon already running
Jul 27 12:39:11 user nova-compute[70994]: WARNING oslo_privsep.priv_context [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] privsep daemon already running
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Successfully created port: b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk 1073741824" returned: 0 in 0.044s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.178s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.130s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk 1073741824" returned: 0 in 0.054s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.377s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Cannot resize image /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Ensure instance console log exists: /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk 1073741824" returned: 0 in 0.059s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Cannot resize image /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Ensure instance console log exists: /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Cannot resize image /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'migration_context' on Instance uuid b33c60f9-d979-419e-aa9a-9f0844c35e62 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Ensure instance console log exists: /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:13 user nova-compute[70994]: INFO nova.compute.claims [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Claim successful on node user
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.300s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:13 user nova-compute[70994]: INFO nova.compute.claims [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Claim successful on node user
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Successfully created port: 6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:13 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Successfully created port: 16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Creating image(s)
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "/opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "/opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "/opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.policy [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17860e9315e646d2a387f9925c9b8ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8fb873d37f845b7b9f52b9833e5a991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Creating image(s)
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "/opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk 1073741824" returned: 0 in 0.075s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.121s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.129s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Cannot resize image /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.objects.instance [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lazy-loading 'migration_context' on Instance uuid 953c1df6-c793-4181-a52b-8c5da4256afd {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Ensure instance console log exists: /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk 1073741824" returned: 0 in 0.045s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.125s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.policy [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '593a7d28021a47b491c7fa86af3edc80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cd4ff8af2445179cc6ba07c251dd4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Cannot resize image /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'migration_context' on Instance uuid 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Ensure instance console log exists: /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Successfully updated port: 16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:17 user nova-compute[70994]: INFO nova.compute.claims [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Claim successful on node user
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-changed-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Refreshing instance network info cache due to event network-changed-16971332-b334-4a2d-99a6-2336809450e6. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:17 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:17 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Creating image(s)
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.117s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.123s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk 1073741824" returned: 0 in 0.040s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Successfully updated port: b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquired lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.policy [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0ba1f1c8b842c4b1067033391456ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0451def811f34a848fd1450763964b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.122s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Cannot resize image /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'migration_context' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Ensure instance console log exists: /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-changed-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Refreshing instance network info cache due to event network-changed-b39988d1-bde2-4498-846c-a335093246e0. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] Acquiring lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance network_info: |[{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.neutron [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Refreshing network info cache for port 16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start _get_guest_xml network_info=[{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236902550',display_name='tempest-ServerRescueNegativeTestJSON-server-236902550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236902550',id=1,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-mhva2p0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:09Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=9a42d4ce-c56b-4ad3-a1b5-61de584a48a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:18 user nova-compute[70994]:   <uuid>9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</uuid>
Jul 27 12:39:18 user nova-compute[70994]:   <name>instance-00000001</name>
Jul 27 12:39:18 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:18 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:18 user nova-compute[70994]:   <metadata>
Jul 27 12:39:18 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:18 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-236902550</nova:name>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:18</nova:creationTime>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:18 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:18 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:39:18 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:18 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:18 user nova-compute[70994]:         <nova:port uuid="16971332-b334-4a2d-99a6-2336809450e6">
Jul 27 12:39:18 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 12:39:18 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:18 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:18 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:18 user nova-compute[70994]:   </metadata>
Jul 27 12:39:18 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:18 user nova-compute[70994]:     <system>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="serial">9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</entry>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="uuid">9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</entry>
Jul 27 12:39:18 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:18 user nova-compute[70994]:     </system>
Jul 27 12:39:18 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:18 user nova-compute[70994]:   <os>
Jul 27 12:39:18 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:18 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:18 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:18 user nova-compute[70994]:   </os>
Jul 27 12:39:18 user nova-compute[70994]:   <features>
Jul 27 12:39:18 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:18 user nova-compute[70994]:     <apic/>
Jul 27 12:39:18 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:18 user nova-compute[70994]:   </features>
Jul 27 12:39:18 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:18 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:18 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:18 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:18 user nova-compute[70994]:   </clock>
Jul 27 12:39:18 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:18 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:18 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:18 user nova-compute[70994]:   </cpu>
Jul 27 12:39:18 user nova-compute[70994]:   <devices>
Jul 27 12:39:18 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:18 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:18 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk"/>
Jul 27 12:39:18 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:18 user nova-compute[70994]:     </disk>
Jul 27 12:39:18 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:18 user nova-compute[70994]:       <mac address="fa:16:3e:00:43:57"/>
Jul 27 12:39:18 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:18 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:18 user nova-compute[70994]:       <target dev="tap16971332-b3"/>
Jul 27 12:39:18 user nova-compute[70994]:     </interface>
Jul 27 12:39:18 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:18 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/console.log" append="off"/>
Jul 27 12:39:18 user nova-compute[70994]:     </serial>
Jul 27 12:39:18 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:18 user nova-compute[70994]:     <video>
Jul 27 12:39:18 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:18 user nova-compute[70994]:     </video>
Jul 27 12:39:18 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:18 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:18 user nova-compute[70994]:     </rng>
Jul 27 12:39:18 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:18 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:18 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:18 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:18 user nova-compute[70994]:   </devices>
Jul 27 12:39:18 user nova-compute[70994]: </domain>
Jul 27 12:39:18 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236902550',display_name='tempest-ServerRescueNegativeTestJSON-server-236902550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236902550',id=1,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-mhva2p0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:09Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=9a42d4ce-c56b-4ad3-a1b5-61de584a48a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG os_vif [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Created schema index Interface.name {{(pid=70994) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Created schema index Port.name {{(pid=70994) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Created schema index Bridge.name {{(pid=70994) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [POLLOUT] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:18 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpuik6081l/privsep.sock']
Jul 27 12:39:18 user sudo[80360]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpuik6081l/privsep.sock
Jul 27 12:39:18 user sudo[80360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:19 user nova-compute[70994]: INFO nova.compute.claims [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Claim successful on node user
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Successfully created port: 63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:19 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Successfully created port: f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:19 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Creating image(s)
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "/opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "/opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG nova.policy [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549272be22b842818d896dd8e4f79132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bb670b38a14ac6a4583f39b7cfedb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Successfully updated port: 6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk 1073741824" returned: 0 in 0.061s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updated VIF entry in instance network info cache for port 16971332-b334-4a2d-99a6-2336809450e6. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.116s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4ff4a70d-e167-4e4b-a0bd-e5c128df8c52 req-82466bdd-5e5b-4dd7-98b8-72467b8c90b0 service nova] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:20 user sudo[80360]: pam_unix(sudo:session): session closed for user root
Jul 27 12:39:20 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Spawned new privsep daemon via rootwrap
Jul 27 12:39:20 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 12:39:20 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 12:39:20 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 27 12:39:20 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80367
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Cannot resize image /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'migration_context' on Instance uuid 2e5e427a-a4a8-4a94-bae5-cde57b96959b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Ensure instance console log exists: /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-changed-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Refreshing instance network info cache due to event network-changed-6c9ac57f-028b-466a-bb8f-5b74e174dcd6. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] Acquiring lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:20 user nova-compute[70994]: INFO nova.compute.claims [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Claim successful on node user
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updating instance_info_cache with network_info: [{"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Releasing lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Instance network_info: |[{"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] Acquired lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Refreshing network info cache for port b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Start _get_guest_xml network_info=[{"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:20 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:20 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-615866170',display_name='tempest-ServersNegativeTestJSON-server-615866170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-615866170',id=2,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-jptcwggv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:09Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=b33c60f9-d979-419e-aa9a-9f0844c35e62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'pci_devices' on Instance uuid b33c60f9-d979-419e-aa9a-9f0844c35e62 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:20 user nova-compute[70994]:   <uuid>b33c60f9-d979-419e-aa9a-9f0844c35e62</uuid>
Jul 27 12:39:20 user nova-compute[70994]:   <name>instance-00000002</name>
Jul 27 12:39:20 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:20 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:20 user nova-compute[70994]:   <metadata>
Jul 27 12:39:20 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:20 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:name>tempest-ServersNegativeTestJSON-server-615866170</nova:name>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:20</nova:creationTime>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:20 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:20 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:user uuid="f524fef921904389beb9e62ddd33512e">tempest-ServersNegativeTestJSON-334834209-project-member</nova:user>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:project uuid="11c5028166444a07a4f9ccdc9206df91">tempest-ServersNegativeTestJSON-334834209</nova:project>
Jul 27 12:39:20 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:20 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:20 user nova-compute[70994]:         <nova:port uuid="b39988d1-bde2-4498-846c-a335093246e0">
Jul 27 12:39:20 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:39:20 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:20 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:20 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:20 user nova-compute[70994]:   </metadata>
Jul 27 12:39:20 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:20 user nova-compute[70994]:     <system>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="serial">b33c60f9-d979-419e-aa9a-9f0844c35e62</entry>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="uuid">b33c60f9-d979-419e-aa9a-9f0844c35e62</entry>
Jul 27 12:39:20 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:20 user nova-compute[70994]:     </system>
Jul 27 12:39:20 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:20 user nova-compute[70994]:   <os>
Jul 27 12:39:20 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:20 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:20 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:20 user nova-compute[70994]:   </os>
Jul 27 12:39:20 user nova-compute[70994]:   <features>
Jul 27 12:39:20 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:20 user nova-compute[70994]:     <apic/>
Jul 27 12:39:20 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:20 user nova-compute[70994]:   </features>
Jul 27 12:39:20 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:20 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:20 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:20 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:20 user nova-compute[70994]:   </clock>
Jul 27 12:39:20 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:20 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:20 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:20 user nova-compute[70994]:   </cpu>
Jul 27 12:39:20 user nova-compute[70994]:   <devices>
Jul 27 12:39:20 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:20 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:20 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk"/>
Jul 27 12:39:20 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:20 user nova-compute[70994]:     </disk>
Jul 27 12:39:20 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:20 user nova-compute[70994]:       <mac address="fa:16:3e:bb:3a:48"/>
Jul 27 12:39:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:20 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:20 user nova-compute[70994]:       <target dev="tapb39988d1-bd"/>
Jul 27 12:39:20 user nova-compute[70994]:     </interface>
Jul 27 12:39:20 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:20 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/console.log" append="off"/>
Jul 27 12:39:20 user nova-compute[70994]:     </serial>
Jul 27 12:39:20 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:20 user nova-compute[70994]:     <video>
Jul 27 12:39:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:20 user nova-compute[70994]:     </video>
Jul 27 12:39:20 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:20 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:20 user nova-compute[70994]:     </rng>
Jul 27 12:39:20 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:20 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:20 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:20 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:20 user nova-compute[70994]:   </devices>
Jul 27 12:39:20 user nova-compute[70994]: </domain>
Jul 27 12:39:20 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-615866170',display_name='tempest-ServersNegativeTestJSON-server-615866170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-615866170',id=2,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-jptcwggv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:09Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=b33c60f9-d979-419e-aa9a-9f0844c35e62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG os_vif [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb39988d1-bd, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb39988d1-bd, col_values=(('external_ids', {'iface-id': 'b39988d1-bde2-4498-846c-a335093246e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:3a:48', 'vm-uuid': 'b33c60f9-d979-419e-aa9a-9f0844c35e62'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16971332-b3, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16971332-b3, col_values=(('external_ids', {'iface-id': '16971332-b334-4a2d-99a6-2336809450e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:43:57', 'vm-uuid': '9a42d4ce-c56b-4ad3-a1b5-61de584a48a7'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:20 user nova-compute[70994]: INFO os_vif [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd')
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:20 user nova-compute[70994]: INFO os_vif [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3')
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] No VIF found with MAC fa:16:3e:bb:3a:48, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:00:43:57, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Creating image(s)
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.123s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.policy [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e02d7aebd3e46beb2f554956eb3804c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba79eb748dd4e26b0be6a26705bda45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk 1073741824" returned: 0 in 0.042s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.115s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Cannot resize image /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG nova.objects.instance [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'migration_context' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Ensure instance console log exists: /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Successfully created port: 5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Successfully created port: 5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance network_info: |[{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] Acquired lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Refreshing network info cache for port 6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start _get_guest_xml network_info=[{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-365758352',display_name='tempest-ServerRescueNegativeTestJSON-server-365758352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-365758352',id=3,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-p5w2b089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:11Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=e31094ff-43ca-4256-a933-25ee73995818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:23 user nova-compute[70994]:   <uuid>e31094ff-43ca-4256-a933-25ee73995818</uuid>
Jul 27 12:39:23 user nova-compute[70994]:   <name>instance-00000003</name>
Jul 27 12:39:23 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:23 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:23 user nova-compute[70994]:   <metadata>
Jul 27 12:39:23 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:23 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-365758352</nova:name>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:23</nova:creationTime>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:23 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:23 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:39:23 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:23 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:23 user nova-compute[70994]:         <nova:port uuid="6c9ac57f-028b-466a-bb8f-5b74e174dcd6">
Jul 27 12:39:23 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:39:23 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:23 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:23 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:23 user nova-compute[70994]:   </metadata>
Jul 27 12:39:23 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:23 user nova-compute[70994]:     <system>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="serial">e31094ff-43ca-4256-a933-25ee73995818</entry>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="uuid">e31094ff-43ca-4256-a933-25ee73995818</entry>
Jul 27 12:39:23 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:23 user nova-compute[70994]:     </system>
Jul 27 12:39:23 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:23 user nova-compute[70994]:   <os>
Jul 27 12:39:23 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:23 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:23 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:23 user nova-compute[70994]:   </os>
Jul 27 12:39:23 user nova-compute[70994]:   <features>
Jul 27 12:39:23 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:23 user nova-compute[70994]:     <apic/>
Jul 27 12:39:23 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:23 user nova-compute[70994]:   </features>
Jul 27 12:39:23 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:23 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:23 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:23 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:23 user nova-compute[70994]:   </clock>
Jul 27 12:39:23 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:23 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:23 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:23 user nova-compute[70994]:   </cpu>
Jul 27 12:39:23 user nova-compute[70994]:   <devices>
Jul 27 12:39:23 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:23 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:23 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk"/>
Jul 27 12:39:23 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:23 user nova-compute[70994]:     </disk>
Jul 27 12:39:23 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:23 user nova-compute[70994]:       <mac address="fa:16:3e:24:04:48"/>
Jul 27 12:39:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:23 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:23 user nova-compute[70994]:       <target dev="tap6c9ac57f-02"/>
Jul 27 12:39:23 user nova-compute[70994]:     </interface>
Jul 27 12:39:23 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:23 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/console.log" append="off"/>
Jul 27 12:39:23 user nova-compute[70994]:     </serial>
Jul 27 12:39:23 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:23 user nova-compute[70994]:     <video>
Jul 27 12:39:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:23 user nova-compute[70994]:     </video>
Jul 27 12:39:23 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:23 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:23 user nova-compute[70994]:     </rng>
Jul 27 12:39:23 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:23 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:23 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:23 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:23 user nova-compute[70994]:   </devices>
Jul 27 12:39:23 user nova-compute[70994]: </domain>
Jul 27 12:39:23 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-365758352',display_name='tempest-ServerRescueNegativeTestJSON-server-365758352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-365758352',id=3,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-p5w2b089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:11Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=e31094ff-43ca-4256-a933-25ee73995818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG os_vif [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9ac57f-02, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9ac57f-02, col_values=(('external_ids', {'iface-id': '6c9ac57f-028b-466a-bb8f-5b74e174dcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:04:48', 'vm-uuid': 'e31094ff-43ca-4256-a933-25ee73995818'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: INFO os_vif [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02')
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Successfully created port: 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:24:04:48, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updated VIF entry in instance network info cache for port b39988d1-bde2-4498-846c-a335093246e0. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updating instance_info_cache with network_info: [{"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-31424934-3eb8-41e1-814e-5bffc0dcca50 req-fbaf6518-56c3-411d-a255-c4d6ba14af38 service nova] Releasing lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:23 user nova-compute[70994]: WARNING nova.compute.manager [req-1e644853-62e2-42d5-9730-2b7318df49c8 req-c51bbe16-5b6a-4327-af01-825f09d9094b service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state building and task_state spawning.
Jul 27 12:39:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:24 user nova-compute[70994]: WARNING nova.compute.manager [req-be7eef02-0136-4053-be29-e104bba1bd5b req-9cf4c775-cf23-4bc8-8fed-47b7d31a993a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state building and task_state spawning.
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Successfully updated port: 5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Successfully updated port: 63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquired lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquired lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-changed-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Refreshing instance network info cache due to event network-changed-63433765-2221-40a7-b5b0-ac7195558a10. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] Acquiring lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Successfully updated port: f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updated VIF entry in instance network info cache for port 6c9ac57f-028b-466a-bb8f-5b74e174dcd6. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc1a5c86-4303-44cc-9596-f6c284b5c750 req-72e9224a-4f1c-4d02-84f0-645f8195a2a6 service nova] Releasing lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:26 user nova-compute[70994]: WARNING nova.compute.manager [req-593b1cd5-8bcf-48a9-98ab-915236cfbf41 req-5a6d2763-b597-4eb5-91ae-1ae5e7d4ec96 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state building and task_state spawning.
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Updating instance_info_cache with network_info: [{"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Releasing lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Instance network_info: |[{"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] Acquired lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Refreshing network info cache for port 63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Start _get_guest_xml network_info=[{"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:26 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:26 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479237388',display_name='tempest-DeleteServersTestJSON-server-479237388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-479237388',id=4,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fb873d37f845b7b9f52b9833e5a991',ramdisk_id='',reservation_id='r-8iil0v0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-742861528',owner_user_name='tempest-DeleteServersTestJSON-742861528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:14Z,user_data=None,user_id='17860e9315e646d2a387f9925c9b8ccb',uuid=953c1df6-c793-4181-a52b-8c5da4256afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converting VIF {"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.objects.instance [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lazy-loading 'pci_devices' on Instance uuid 953c1df6-c793-4181-a52b-8c5da4256afd {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:26 user nova-compute[70994]:   <uuid>953c1df6-c793-4181-a52b-8c5da4256afd</uuid>
Jul 27 12:39:26 user nova-compute[70994]:   <name>instance-00000004</name>
Jul 27 12:39:26 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:26 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:26 user nova-compute[70994]:   <metadata>
Jul 27 12:39:26 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:26 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:name>tempest-DeleteServersTestJSON-server-479237388</nova:name>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:26</nova:creationTime>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:26 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:26 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:user uuid="17860e9315e646d2a387f9925c9b8ccb">tempest-DeleteServersTestJSON-742861528-project-member</nova:user>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:project uuid="e8fb873d37f845b7b9f52b9833e5a991">tempest-DeleteServersTestJSON-742861528</nova:project>
Jul 27 12:39:26 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:26 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:26 user nova-compute[70994]:         <nova:port uuid="63433765-2221-40a7-b5b0-ac7195558a10">
Jul 27 12:39:26 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 12:39:26 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:26 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:26 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:26 user nova-compute[70994]:   </metadata>
Jul 27 12:39:26 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:26 user nova-compute[70994]:     <system>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="serial">953c1df6-c793-4181-a52b-8c5da4256afd</entry>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="uuid">953c1df6-c793-4181-a52b-8c5da4256afd</entry>
Jul 27 12:39:26 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:26 user nova-compute[70994]:     </system>
Jul 27 12:39:26 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:26 user nova-compute[70994]:   <os>
Jul 27 12:39:26 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:26 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:26 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:26 user nova-compute[70994]:   </os>
Jul 27 12:39:26 user nova-compute[70994]:   <features>
Jul 27 12:39:26 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:26 user nova-compute[70994]:     <apic/>
Jul 27 12:39:26 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:26 user nova-compute[70994]:   </features>
Jul 27 12:39:26 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:26 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:26 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:26 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:26 user nova-compute[70994]:   </clock>
Jul 27 12:39:26 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:26 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:26 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:26 user nova-compute[70994]:   </cpu>
Jul 27 12:39:26 user nova-compute[70994]:   <devices>
Jul 27 12:39:26 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:26 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:26 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk"/>
Jul 27 12:39:26 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:26 user nova-compute[70994]:     </disk>
Jul 27 12:39:26 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:26 user nova-compute[70994]:       <mac address="fa:16:3e:d6:0b:6a"/>
Jul 27 12:39:26 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:26 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:26 user nova-compute[70994]:       <target dev="tap63433765-22"/>
Jul 27 12:39:26 user nova-compute[70994]:     </interface>
Jul 27 12:39:26 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:26 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/console.log" append="off"/>
Jul 27 12:39:26 user nova-compute[70994]:     </serial>
Jul 27 12:39:26 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:26 user nova-compute[70994]:     <video>
Jul 27 12:39:26 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:26 user nova-compute[70994]:     </video>
Jul 27 12:39:26 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:26 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:26 user nova-compute[70994]:     </rng>
Jul 27 12:39:26 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:26 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:26 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:26 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:26 user nova-compute[70994]:   </devices>
Jul 27 12:39:26 user nova-compute[70994]: </domain>
Jul 27 12:39:26 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479237388',display_name='tempest-DeleteServersTestJSON-server-479237388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-479237388',id=4,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fb873d37f845b7b9f52b9833e5a991',ramdisk_id='',reservation_id='r-8iil0v0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-742861528',owner_user_name='tempest-DeleteServersTestJSON-742861528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:14Z,user_data=None,user_id='17860e9315e646d2a387f9925c9b8ccb',uuid=953c1df6-c793-4181-a52b-8c5da4256afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converting VIF {"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG os_vif [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63433765-22, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63433765-22, col_values=(('external_ids', {'iface-id': '63433765-2221-40a7-b5b0-ac7195558a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:0b:6a', 'vm-uuid': '953c1df6-c793-4181-a52b-8c5da4256afd'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:26 user nova-compute[70994]: INFO os_vif [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22')
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] No VIF found with MAC fa:16:3e:d6:0b:6a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:26 user nova-compute[70994]: WARNING nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state building and task_state spawning.
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-changed-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Refreshing instance network info cache due to event network-changed-5342fa4a-a64a-4af0-a4ba-8cf183415666. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Acquiring lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Successfully updated port: 5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updating instance_info_cache with network_info: [{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Releasing lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Instance network_info: |[{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Acquired lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:26 user nova-compute[70994]: DEBUG nova.network.neutron [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Refreshing network info cache for port 5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Start _get_guest_xml network_info=[{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.0810661, b33c60f9-d979-419e-aa9a-9f0844c35e62 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] VM Resumed (Lifecycle Event)
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Instance spawned successfully.
Jul 27 12:39:27 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:27 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance spawned successfully.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1668109159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1668109159',id=7,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG1fMtpuWv5B2HQ824g1AGTuy7NM/2AjeINuI0Lplb3OAuM+Z7m0KaESeZowkBYdz4tOdFVuz/JbJcv35qAJ8ub93X2Fly963wDRp9dnZaX5rNQwlvTfMdqpWPHzlzS5w==',key_name='tempest-keypair-389590009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-706b902h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2e5e427a-a4a8-4a94-bae5-cde57b96959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e5e427a-a4a8-4a94-bae5-cde57b96959b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:27 user nova-compute[70994]:   <uuid>2e5e427a-a4a8-4a94-bae5-cde57b96959b</uuid>
Jul 27 12:39:27 user nova-compute[70994]:   <name>instance-00000007</name>
Jul 27 12:39:27 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:27 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:27 user nova-compute[70994]:   <metadata>
Jul 27 12:39:27 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:27 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1668109159</nova:name>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:27</nova:creationTime>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:27 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:user uuid="549272be22b842818d896dd8e4f79132">tempest-ServerActionsV293TestJSON-771279538-project-member</nova:user>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:project uuid="21bb670b38a14ac6a4583f39b7cfedb7">tempest-ServerActionsV293TestJSON-771279538</nova:project>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:port uuid="5342fa4a-a64a-4af0-a4ba-8cf183415666">
Jul 27 12:39:27 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 12:39:27 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:27 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:27 user nova-compute[70994]:   </metadata>
Jul 27 12:39:27 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:27 user nova-compute[70994]:     <system>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="serial">2e5e427a-a4a8-4a94-bae5-cde57b96959b</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="uuid">2e5e427a-a4a8-4a94-bae5-cde57b96959b</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:27 user nova-compute[70994]:     </system>
Jul 27 12:39:27 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:27 user nova-compute[70994]:   <os>
Jul 27 12:39:27 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:27 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:27 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:27 user nova-compute[70994]:   </os>
Jul 27 12:39:27 user nova-compute[70994]:   <features>
Jul 27 12:39:27 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:27 user nova-compute[70994]:     <apic/>
Jul 27 12:39:27 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:27 user nova-compute[70994]:   </features>
Jul 27 12:39:27 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:27 user nova-compute[70994]:   </clock>
Jul 27 12:39:27 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:27 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:27 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:27 user nova-compute[70994]:   </cpu>
Jul 27 12:39:27 user nova-compute[70994]:   <devices>
Jul 27 12:39:27 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:27 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:27 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk"/>
Jul 27 12:39:27 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:     </disk>
Jul 27 12:39:27 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:27 user nova-compute[70994]:       <mac address="fa:16:3e:dd:85:56"/>
Jul 27 12:39:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:27 user nova-compute[70994]:       <target dev="tap5342fa4a-a6"/>
Jul 27 12:39:27 user nova-compute[70994]:     </interface>
Jul 27 12:39:27 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:27 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/console.log" append="off"/>
Jul 27 12:39:27 user nova-compute[70994]:     </serial>
Jul 27 12:39:27 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:27 user nova-compute[70994]:     <video>
Jul 27 12:39:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:     </video>
Jul 27 12:39:27 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:27 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:27 user nova-compute[70994]:     </rng>
Jul 27 12:39:27 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:27 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:27 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:27 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:27 user nova-compute[70994]:   </devices>
Jul 27 12:39:27 user nova-compute[70994]: </domain>
Jul 27 12:39:27 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1668109159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1668109159',id=7,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG1fMtpuWv5B2HQ824g1AGTuy7NM/2AjeINuI0Lplb3OAuM+Z7m0KaESeZowkBYdz4tOdFVuz/JbJcv35qAJ8ub93X2Fly963wDRp9dnZaX5rNQwlvTfMdqpWPHzlzS5w==',key_name='tempest-keypair-389590009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-706b902h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2e5e427a-a4a8-4a94-bae5-cde57b96959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG os_vif [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5342fa4a-a6, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5342fa4a-a6, col_values=(('external_ids', {'iface-id': '5342fa4a-a64a-4af0-a4ba-8cf183415666', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:85:56', 'vm-uuid': '2e5e427a-a4a8-4a94-bae5-cde57b96959b'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: INFO os_vif [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6')
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.084576, b33c60f9-d979-419e-aa9a-9f0844c35e62 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] VM Started (Lifecycle Event)
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Took 18.66 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Took 17.86 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-changed-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Refreshing instance network info cache due to event network-changed-f2212946-0b37-4110-8c9f-6252209e2730. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] Acquiring lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No VIF found with MAC fa:16:3e:dd:85:56, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Took 19.07 seconds to build instance.
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Took 19.96 seconds to build instance.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.0994296, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Resumed (Lifecycle Event)
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-eb1ffc60-26bc-41d7-b87f-0804318669df tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.227s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ac6a05f-154c-4d4a-9335-41159fc3313b tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.193s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Instance network_info: |[{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] Acquired lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Refreshing network info cache for port f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Start _get_guest_xml network_info=[{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:27 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:27 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1853910336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1853910336',id=5,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-mxvdwj6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:14Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=52d02a1a-66ef-4b18-bd24-1326cfd1b1c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:27 user nova-compute[70994]:   <uuid>52d02a1a-66ef-4b18-bd24-1326cfd1b1c0</uuid>
Jul 27 12:39:27 user nova-compute[70994]:   <name>instance-00000005</name>
Jul 27 12:39:27 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:27 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:27 user nova-compute[70994]:   <metadata>
Jul 27 12:39:27 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:27 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1853910336</nova:name>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:27</nova:creationTime>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:27 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:27 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:27 user nova-compute[70994]:         <nova:port uuid="f2212946-0b37-4110-8c9f-6252209e2730">
Jul 27 12:39:27 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 12:39:27 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:27 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:27 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:27 user nova-compute[70994]:   </metadata>
Jul 27 12:39:27 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:27 user nova-compute[70994]:     <system>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="serial">52d02a1a-66ef-4b18-bd24-1326cfd1b1c0</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="uuid">52d02a1a-66ef-4b18-bd24-1326cfd1b1c0</entry>
Jul 27 12:39:27 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:27 user nova-compute[70994]:     </system>
Jul 27 12:39:27 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:27 user nova-compute[70994]:   <os>
Jul 27 12:39:27 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:27 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:27 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:27 user nova-compute[70994]:   </os>
Jul 27 12:39:27 user nova-compute[70994]:   <features>
Jul 27 12:39:27 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:27 user nova-compute[70994]:     <apic/>
Jul 27 12:39:27 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:27 user nova-compute[70994]:   </features>
Jul 27 12:39:27 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:27 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:27 user nova-compute[70994]:   </clock>
Jul 27 12:39:27 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:27 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:27 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:27 user nova-compute[70994]:   </cpu>
Jul 27 12:39:27 user nova-compute[70994]:   <devices>
Jul 27 12:39:27 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:27 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:27 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk"/>
Jul 27 12:39:27 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:     </disk>
Jul 27 12:39:27 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:27 user nova-compute[70994]:       <mac address="fa:16:3e:6f:73:dc"/>
Jul 27 12:39:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:27 user nova-compute[70994]:       <target dev="tapf2212946-0b"/>
Jul 27 12:39:27 user nova-compute[70994]:     </interface>
Jul 27 12:39:27 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:27 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/console.log" append="off"/>
Jul 27 12:39:27 user nova-compute[70994]:     </serial>
Jul 27 12:39:27 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:27 user nova-compute[70994]:     <video>
Jul 27 12:39:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:27 user nova-compute[70994]:     </video>
Jul 27 12:39:27 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:27 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:27 user nova-compute[70994]:     </rng>
Jul 27 12:39:27 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:27 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:27 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:27 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:27 user nova-compute[70994]:   </devices>
Jul 27 12:39:27 user nova-compute[70994]: </domain>
Jul 27 12:39:27 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1853910336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1853910336',id=5,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-mxvdwj6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:14Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=52d02a1a-66ef-4b18-bd24-1326cfd1b1c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG os_vif [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2212946-0b, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2212946-0b, col_values=(('external_ids', {'iface-id': 'f2212946-0b37-4110-8c9f-6252209e2730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:73:dc', 'vm-uuid': '52d02a1a-66ef-4b18-bd24-1326cfd1b1c0'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.104959, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Started (Lifecycle Event)
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Successfully updated port: 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: INFO os_vif [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b')
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Updated VIF entry in instance network info cache for port 63433765-2221-40a7-b5b0-ac7195558a10. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.network.neutron [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Updating instance_info_cache with network_info: [{"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance spawned successfully.
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d982bbc9-0de3-43a5-aa1f-2c3dc19b6070 req-6f1521a5-86c9-446e-bdae-8a06074af66f service nova] Releasing lock "refresh_cache-953c1df6-c793-4181-a52b-8c5da4256afd" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.8855, e31094ff-43ca-4256-a933-25ee73995818 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] VM Resumed (Lifecycle Event)
Jul 27 12:39:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:6f:73:dc, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461567.8881836, e31094ff-43ca-4256-a933-25ee73995818 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] VM Started (Lifecycle Event)
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:28 user nova-compute[70994]: INFO nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Took 17.29 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing instance network info cache due to event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:28 user nova-compute[70994]: INFO nova.compute.manager [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Took 17.95 seconds to build instance.
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-11fcf39d-4ce5-49fa-a891-e50606d79463 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.080s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:28 user nova-compute[70994]: WARNING nova.compute.manager [req-082a2010-5b12-4875-b348-b6a82164ea57 req-5139319d-67f2-4174-80d7-47f5ab21683d service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state active and task_state None.
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance network_info: |[{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.network.neutron [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start _get_guest_xml network_info=[{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:28 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:28 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1950997778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.objects.instance [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:29 user nova-compute[70994]:   <uuid>7ae0f3cc-df1c-4427-9ab7-c7f0171de791</uuid>
Jul 27 12:39:29 user nova-compute[70994]:   <name>instance-00000008</name>
Jul 27 12:39:29 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:29 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:29 user nova-compute[70994]:   <metadata>
Jul 27 12:39:29 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:29 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherA-server-1950997778</nova:name>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:28</nova:creationTime>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:29 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:29 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:user uuid="2e02d7aebd3e46beb2f554956eb3804c">tempest-ServerActionsTestOtherA-1320950418-project-member</nova:user>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:project uuid="dba79eb748dd4e26b0be6a26705bda45">tempest-ServerActionsTestOtherA-1320950418</nova:project>
Jul 27 12:39:29 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:29 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:29 user nova-compute[70994]:         <nova:port uuid="5389c431-e670-4b72-9d85-ff6cf932bd22">
Jul 27 12:39:29 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:39:29 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:29 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:29 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:29 user nova-compute[70994]:   </metadata>
Jul 27 12:39:29 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:29 user nova-compute[70994]:     <system>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="serial">7ae0f3cc-df1c-4427-9ab7-c7f0171de791</entry>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="uuid">7ae0f3cc-df1c-4427-9ab7-c7f0171de791</entry>
Jul 27 12:39:29 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:29 user nova-compute[70994]:     </system>
Jul 27 12:39:29 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:29 user nova-compute[70994]:   <os>
Jul 27 12:39:29 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:29 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:29 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:29 user nova-compute[70994]:   </os>
Jul 27 12:39:29 user nova-compute[70994]:   <features>
Jul 27 12:39:29 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:29 user nova-compute[70994]:     <apic/>
Jul 27 12:39:29 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:29 user nova-compute[70994]:   </features>
Jul 27 12:39:29 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:29 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:29 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:29 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:29 user nova-compute[70994]:   </clock>
Jul 27 12:39:29 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:29 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:29 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:29 user nova-compute[70994]:   </cpu>
Jul 27 12:39:29 user nova-compute[70994]:   <devices>
Jul 27 12:39:29 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:29 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:29 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk"/>
Jul 27 12:39:29 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:29 user nova-compute[70994]:     </disk>
Jul 27 12:39:29 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:29 user nova-compute[70994]:       <mac address="fa:16:3e:23:46:4b"/>
Jul 27 12:39:29 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:29 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:29 user nova-compute[70994]:       <target dev="tap5389c431-e6"/>
Jul 27 12:39:29 user nova-compute[70994]:     </interface>
Jul 27 12:39:29 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:29 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/console.log" append="off"/>
Jul 27 12:39:29 user nova-compute[70994]:     </serial>
Jul 27 12:39:29 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:29 user nova-compute[70994]:     <video>
Jul 27 12:39:29 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:29 user nova-compute[70994]:     </video>
Jul 27 12:39:29 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:29 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:29 user nova-compute[70994]:     </rng>
Jul 27 12:39:29 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:29 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:29 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:29 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:29 user nova-compute[70994]:   </devices>
Jul 27 12:39:29 user nova-compute[70994]: </domain>
Jul 27 12:39:29 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1950997778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG os_vif [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5389c431-e6, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5389c431-e6, col_values=(('external_ids', {'iface-id': '5389c431-e670-4b72-9d85-ff6cf932bd22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:46:4b', 'vm-uuid': '7ae0f3cc-df1c-4427-9ab7-c7f0171de791'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: INFO os_vif [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6')
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No VIF found with MAC fa:16:3e:23:46:4b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updated VIF entry in instance network info cache for port 5342fa4a-a64a-4af0-a4ba-8cf183415666. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updating instance_info_cache with network_info: [{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Releasing lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:29 user nova-compute[70994]: WARNING nova.compute.manager [req-999b721c-ea3b-42cb-9806-b5c1e92c03d7 req-f95ac6f9-aaf6-4d02-a4a6-4a416d34e1f4 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state building and task_state spawning.
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing instance network info cache due to event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance network_info: |[{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start _get_guest_xml network_info=[{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updated VIF entry in instance network info cache for port f2212946-0b37-4110-8c9f-6252209e2730. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a7b0becb-1ce4-4d1f-800e-ddea6c11bd30 req-58d44e99-9b6a-48c5-a474-7e1873e8ef92 service nova] Releasing lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] No waiting events found dispatching network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:30 user nova-compute[70994]: WARNING nova.compute.manager [req-403ecbce-3a4a-4cf8-8be5-3aaaf1428215 req-8bd79f9a-2a31-4a28-aca2-539df12352e3 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received unexpected event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 for instance with vm_state building and task_state spawning.
Jul 27 12:39:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updated VIF entry in instance network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updated VIF entry in instance network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80bc8233-327a-4fda-b407-d87bbb5ef770 req-b2b70b16-6bc9-4ea1-91b6-65e8278b7ebe service nova] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8969703f-566d-4e24-b109-4702f8f7358f req-bb6bdf30-4679-4ebb-b177-e23f1213f945 service nova] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] No waiting events found dispatching network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:31 user nova-compute[70994]: WARNING nova.compute.manager [req-e92edb89-0ff5-40f2-b0fc-f49f96918a6d req-1109d7e6-e6e6-4726-adfa-eb429c991020 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received unexpected event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 for instance with vm_state building and task_state spawning.
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] No waiting events found dispatching network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:32 user nova-compute[70994]: WARNING nova.compute.manager [req-70fb9531-b6a8-4d79-ba4b-b58243c4cedf req-15520573-2cf9-4d18-aaab-c42597998436 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received unexpected event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 for instance with vm_state building and task_state spawning.
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:33 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHA/0ZdIUUbuXgXuYWyt8Ne9/98bA7k/UnTKqmwDW5XVpm4ojrYuM0B8LSBiW3zj3V03WTiJfa4aimiP/566c7Yds/L0cTgvtmWuKEOEfouSNK3EYYKsckqZy9YEHPmDQ==',key_name='tempest-keypair-1555823318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:33 user nova-compute[70994]:   <uuid>4a853286-11ba-4a34-824b-bc59b8a5ac50</uuid>
Jul 27 12:39:33 user nova-compute[70994]:   <name>instance-00000006</name>
Jul 27 12:39:33 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:33 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:33 user nova-compute[70994]:   <metadata>
Jul 27 12:39:33 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:33 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1544413435</nova:name>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:33</nova:creationTime>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:33 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:33 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:user uuid="5a0ba1f1c8b842c4b1067033391456ab">tempest-AttachVolumeShelveTestJSON-1527010192-project-member</nova:user>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:project uuid="0451def811f34a848fd1450763964b49">tempest-AttachVolumeShelveTestJSON-1527010192</nova:project>
Jul 27 12:39:33 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:33 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:33 user nova-compute[70994]:         <nova:port uuid="3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f">
Jul 27 12:39:33 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 12:39:33 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:33 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:33 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:33 user nova-compute[70994]:   </metadata>
Jul 27 12:39:33 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:33 user nova-compute[70994]:     <system>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="serial">4a853286-11ba-4a34-824b-bc59b8a5ac50</entry>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="uuid">4a853286-11ba-4a34-824b-bc59b8a5ac50</entry>
Jul 27 12:39:33 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:33 user nova-compute[70994]:     </system>
Jul 27 12:39:33 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:33 user nova-compute[70994]:   <os>
Jul 27 12:39:33 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:33 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:33 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:33 user nova-compute[70994]:   </os>
Jul 27 12:39:33 user nova-compute[70994]:   <features>
Jul 27 12:39:33 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:33 user nova-compute[70994]:     <apic/>
Jul 27 12:39:33 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:33 user nova-compute[70994]:   </features>
Jul 27 12:39:33 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:33 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:33 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:33 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:33 user nova-compute[70994]:   </clock>
Jul 27 12:39:33 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:33 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:33 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:33 user nova-compute[70994]:   </cpu>
Jul 27 12:39:33 user nova-compute[70994]:   <devices>
Jul 27 12:39:33 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:33 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:33 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk"/>
Jul 27 12:39:33 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:33 user nova-compute[70994]:     </disk>
Jul 27 12:39:33 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:33 user nova-compute[70994]:       <mac address="fa:16:3e:13:ab:63"/>
Jul 27 12:39:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:33 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:33 user nova-compute[70994]:       <target dev="tap3f23a04a-22"/>
Jul 27 12:39:33 user nova-compute[70994]:     </interface>
Jul 27 12:39:33 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:33 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/console.log" append="off"/>
Jul 27 12:39:33 user nova-compute[70994]:     </serial>
Jul 27 12:39:33 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:33 user nova-compute[70994]:     <video>
Jul 27 12:39:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:33 user nova-compute[70994]:     </video>
Jul 27 12:39:33 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:33 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:33 user nova-compute[70994]:     </rng>
Jul 27 12:39:33 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:33 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:33 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:33 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:33 user nova-compute[70994]:   </devices>
Jul 27 12:39:33 user nova-compute[70994]: </domain>
Jul 27 12:39:33 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHA/0ZdIUUbuXgXuYWyt8Ne9/98bA7k/UnTKqmwDW5XVpm4ojrYuM0B8LSBiW3zj3V03WTiJfa4aimiP/566c7Yds/L0cTgvtmWuKEOEfouSNK3EYYKsckqZy9YEHPmDQ==',key_name='tempest-keypair-1555823318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG os_vif [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f23a04a-22, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f23a04a-22, col_values=(('external_ids', {'iface-id': '3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:ab:63', 'vm-uuid': '4a853286-11ba-4a34-824b-bc59b8a5ac50'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: INFO os_vif [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22')
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No VIF found with MAC fa:16:3e:13:ab:63, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] No waiting events found dispatching network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:33 user nova-compute[70994]: WARNING nova.compute.manager [req-52d35b01-2049-4b05-9e3e-b52624c06881 req-b8c0d261-3abe-4b60-a0b1-acce49c342bc service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received unexpected event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 for instance with vm_state building and task_state spawning.
Jul 27 12:39:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:34 user nova-compute[70994]: WARNING nova.compute.manager [req-cfa028b7-092f-4194-a73d-1cda24075783 req-1698a70c-965d-4aa8-8fef-ca525f3bb406 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state building and task_state spawning.
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461576.019259, 953c1df6-c793-4181-a52b-8c5da4256afd => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] VM Resumed (Lifecycle Event)
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Instance spawned successfully.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461576.0246887, 953c1df6-c793-4181-a52b-8c5da4256afd => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] VM Started (Lifecycle Event)
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] No waiting events found dispatching network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:36 user nova-compute[70994]: WARNING nova.compute.manager [req-0ff8e449-94bc-43f3-8334-96e361616c84 req-f5efe950-7ff4-44dd-a497-e186daa29322 service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received unexpected event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 for instance with vm_state building and task_state spawning.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:36 user nova-compute[70994]: WARNING nova.compute.manager [req-a82b23e8-0b57-4871-8f68-cee6b19ba36f req-fb2a2fb3-5f80-49ee-89be-e9083f179bff service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state building and task_state spawning.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json" returned: 0 in 0.590s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:36 user nova-compute[70994]: INFO nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Took 22.67 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.374s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:37 user nova-compute[70994]: INFO nova.compute.manager [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Took 24.07 seconds to build instance.
Jul 27 12:39:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-87703eab-0b7a-4554-9b7a-d0db6342129c tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.223s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.523s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] No waiting events found dispatching network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:38 user nova-compute[70994]: WARNING nova.compute.manager [req-e5e61ecf-d220-4bdd-a51f-cb2e11f7a28c req-be8b7962-823c-4ef6-b16e-4b4914a3579f service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received unexpected event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 for instance with vm_state building and task_state spawning.
Jul 27 12:39:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.0317185, 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] VM Resumed (Lifecycle Event)
Jul 27 12:39:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:41 user nova-compute[70994]: WARNING nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state building and task_state spawning.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:41 user nova-compute[70994]: WARNING nova.compute.manager [req-555fbe14-a6e4-4c48-8fcd-b39f7076d390 req-cd4cfae5-36f0-4177-b921-69ebeaee51af service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state building and task_state spawning.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Instance spawned successfully.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance spawned successfully.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=26.102684020996094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance spawned successfully.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Instance spawned successfully.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.0330992, 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] VM Started (Lifecycle Event)
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Took 20.30 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Took 24.04 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Took 27.37 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.05992, 2e5e427a-a4a8-4a94-bae5-cde57b96959b => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] VM Resumed (Lifecycle Event)
Jul 27 12:39:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:41 user nova-compute[70994]: INFO nova.compute.manager [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Took 21.30 seconds to build instance.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 953c1df6-c793-4181-a52b-8c5da4256afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Took 22.26 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Took 24.93 seconds to build instance.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75aec85f-9313-4c25-82b7-f46b3d84f476 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.602s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Took 28.54 seconds to build instance.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c422d90-ea7c-4058-a6a8-e2b2cb2f5276 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.078s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.0662253, 2e5e427a-a4a8-4a94-bae5-cde57b96959b => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] VM Started (Lifecycle Event)
Jul 27 12:39:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d09bbd1b-1a7d-440c-8ffe-1290a70939b1 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.707s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Took 23.31 seconds to build instance.
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.2230306, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Resumed (Lifecycle Event)
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b44c308d-c039-4812-980c-da0009df119f tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.569s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.2231538, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Resumed (Lifecycle Event)
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.2232747, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Started (Lifecycle Event)
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.630s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461580.223917, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:42 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Started (Lifecycle Event)
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:43 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:43 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:43 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:39:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:39:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:45 user nova-compute[70994]: INFO nova.compute.claims [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Claim successful on node user
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.418s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:45 user nova-compute[70994]: INFO nova.compute.claims [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Claim successful on node user
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Creating image(s)
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "/opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "/opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "/opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG nova.policy [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82176d7d1cc74f33bb116d5f872ce53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44f7ad000945eab5a0030d38ca9dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.270s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.216s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk 1073741824" returned: 0 in 0.110s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.304s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.247s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:47 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.policy [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bab6b6a50d274fdeb10da465b2b89eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ee6c1bd154750aa942c3b582d2bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Cannot resize image /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'migration_context' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Ensure instance console log exists: /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:47 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Creating image(s)
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "/opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "/opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.052s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.170s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Successfully created port: 21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:39:48 user nova-compute[70994]: INFO nova.compute.claims [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Claim successful on node user
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk 1073741824" returned: 0 in 0.066s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.181s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Successfully created port: 294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Cannot resize image /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'migration_context' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Ensure instance console log exists: /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Successfully updated port: 21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquired lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-changed-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Refreshing instance network info cache due to event network-changed-21ff2b01-1000-4d58-b089-15568956e6ab. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] Acquiring lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.964s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:39:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.policy [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d3857a4640c4ae4a30c3ea57735e23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69fffed844249eb87e5f73f4fc862c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating instance_info_cache with network_info: [{"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Releasing lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Instance network_info: |[{"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] Acquired lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.neutron [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Refreshing network info cache for port 21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Start _get_guest_xml network_info=[{"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:39:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Creating image(s)
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:49 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:49 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1342825356',display_name='tempest-TestVolumeSwap-server-1342825356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1342825356',id=9,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwMyZ48fAb/YsJf4stRDUGvVJpgfOdfnfCcoqFvj37eSL0KTIn3Zkfez0Oxe3ki0xGzMAhXp15fsbikbv+waTy7+dRazIlAr6yUlNMXBGVTPb7nroi34WlcM6gHGPUbPw==',key_name='tempest-keypair-1524537095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e44f7ad000945eab5a0030d38ca9dfe',ramdisk_id='',reservation_id='r-did3q75s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1830146653',owner_user_name='tempest-TestVolumeSwap-1830146653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82176d7d1cc74f33bb116d5f872ce53a',uuid=662c50c8-4f10-4cc1-b537-cf31dde13cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converting VIF {"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:49 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'pci_devices' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:50 user nova-compute[70994]:   <uuid>662c50c8-4f10-4cc1-b537-cf31dde13cca</uuid>
Jul 27 12:39:50 user nova-compute[70994]:   <name>instance-00000009</name>
Jul 27 12:39:50 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:50 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:50 user nova-compute[70994]:   <metadata>
Jul 27 12:39:50 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:50 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:name>tempest-TestVolumeSwap-server-1342825356</nova:name>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:49</nova:creationTime>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:50 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:50 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:user uuid="82176d7d1cc74f33bb116d5f872ce53a">tempest-TestVolumeSwap-1830146653-project-member</nova:user>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:project uuid="7e44f7ad000945eab5a0030d38ca9dfe">tempest-TestVolumeSwap-1830146653</nova:project>
Jul 27 12:39:50 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:50 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:50 user nova-compute[70994]:         <nova:port uuid="21ff2b01-1000-4d58-b089-15568956e6ab">
Jul 27 12:39:50 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:39:50 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:50 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:50 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:50 user nova-compute[70994]:   </metadata>
Jul 27 12:39:50 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:50 user nova-compute[70994]:     <system>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="serial">662c50c8-4f10-4cc1-b537-cf31dde13cca</entry>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="uuid">662c50c8-4f10-4cc1-b537-cf31dde13cca</entry>
Jul 27 12:39:50 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:50 user nova-compute[70994]:     </system>
Jul 27 12:39:50 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:50 user nova-compute[70994]:   <os>
Jul 27 12:39:50 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:50 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:50 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:50 user nova-compute[70994]:   </os>
Jul 27 12:39:50 user nova-compute[70994]:   <features>
Jul 27 12:39:50 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:50 user nova-compute[70994]:     <apic/>
Jul 27 12:39:50 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:50 user nova-compute[70994]:   </features>
Jul 27 12:39:50 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:50 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:50 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:50 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:50 user nova-compute[70994]:   </clock>
Jul 27 12:39:50 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:50 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:50 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:50 user nova-compute[70994]:   </cpu>
Jul 27 12:39:50 user nova-compute[70994]:   <devices>
Jul 27 12:39:50 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:50 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:50 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk"/>
Jul 27 12:39:50 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:50 user nova-compute[70994]:     </disk>
Jul 27 12:39:50 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:50 user nova-compute[70994]:       <mac address="fa:16:3e:32:92:7a"/>
Jul 27 12:39:50 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:50 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:50 user nova-compute[70994]:       <target dev="tap21ff2b01-10"/>
Jul 27 12:39:50 user nova-compute[70994]:     </interface>
Jul 27 12:39:50 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:50 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/console.log" append="off"/>
Jul 27 12:39:50 user nova-compute[70994]:     </serial>
Jul 27 12:39:50 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:50 user nova-compute[70994]:     <video>
Jul 27 12:39:50 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:50 user nova-compute[70994]:     </video>
Jul 27 12:39:50 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:50 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:50 user nova-compute[70994]:     </rng>
Jul 27 12:39:50 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:50 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:50 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:50 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:50 user nova-compute[70994]:   </devices>
Jul 27 12:39:50 user nova-compute[70994]: </domain>
Jul 27 12:39:50 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1342825356',display_name='tempest-TestVolumeSwap-server-1342825356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1342825356',id=9,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwMyZ48fAb/YsJf4stRDUGvVJpgfOdfnfCcoqFvj37eSL0KTIn3Zkfez0Oxe3ki0xGzMAhXp15fsbikbv+waTy7+dRazIlAr6yUlNMXBGVTPb7nroi34WlcM6gHGPUbPw==',key_name='tempest-keypair-1524537095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e44f7ad000945eab5a0030d38ca9dfe',ramdisk_id='',reservation_id='r-did3q75s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1830146653',owner_user_name='tempest-TestVolumeSwap-1830146653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82176d7d1cc74f33bb116d5f872ce53a',uuid=662c50c8-4f10-4cc1-b537-cf31dde13cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converting VIF {"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG os_vif [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Successfully updated port: 294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-changed-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Refreshing instance network info cache due to event network-changed-294180fe-682a-4cae-89ad-834369b928a5. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] Acquiring lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] Acquired lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.neutron [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Refreshing network info cache for port 294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ff2b01-10, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21ff2b01-10, col_values=(('external_ids', {'iface-id': '21ff2b01-1000-4d58-b089-15568956e6ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:92:7a', 'vm-uuid': '662c50c8-4f10-4cc1-b537-cf31dde13cca'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:50 user nova-compute[70994]: INFO os_vif [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10')
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.part --force-share --output=json" returned: 0 in 0.319s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.virt.images [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] 7ee54a31-b3d3-42df-9e6e-5f6862bb27cf was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.part /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.neutron [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] No VIF found with MAC fa:16:3e:32:92:7a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.part /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.converted" returned: 0 in 0.307s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.neutron [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updated VIF entry in instance network info cache for port 21ff2b01-1000-4d58-b089-15568956e6ab. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG nova.network.neutron [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating instance_info_cache with network_info: [{"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-01b01ae3-5015-4160-9c7a-ecbef67dd00b req-e01350ce-ae9c-48c9-873a-0eef55b783d2 service nova] Releasing lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.395s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Successfully created port: 5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.network.neutron [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8823c7c5-0318-4518-ae91-da329de71ea9 req-855f59a0-0fde-420a-8ba0-1da0fce3ad10 service nova] Releasing lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquired lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2,backing_fmt=raw /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2,backing_fmt=raw /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk 1073741824" returned: 0 in 0.053s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "2ec940480f99c6eb7e328f4d6e624ebccfb266f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ec940480f99c6eb7e328f4d6e624ebccfb266f2 --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Cannot resize image /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.objects.instance [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'migration_context' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Ensure instance console log exists: /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updating instance_info_cache with network_info: [{"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Releasing lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance network_info: |[{"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Start _get_guest_xml network_info=[{"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:52 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:52 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1207065891',display_name='tempest-VolumesAdminNegativeTest-server-1207065891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1207065891',id=10,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChSrArlyDyBzqE0UhpVHUqG8g7uIRb2KXcSzfBb8dWjE5kCJKLtHKiinEuPDCECKYhLhv0z8uKZpaSed5bUqGErXHTCnUAoXzp2gR9rpuS97KU2qs29zaVzFG5qWSJSpA==',key_name='tempest-keypair-188592589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-3chme8oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=5d2440a0-860c-4700-9fed-224851bec304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.objects.instance [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:52 user nova-compute[70994]:   <uuid>5d2440a0-860c-4700-9fed-224851bec304</uuid>
Jul 27 12:39:52 user nova-compute[70994]:   <name>instance-0000000a</name>
Jul 27 12:39:52 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:52 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:52 user nova-compute[70994]:   <metadata>
Jul 27 12:39:52 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:52 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1207065891</nova:name>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:52</nova:creationTime>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:52 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:52 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:user uuid="bab6b6a50d274fdeb10da465b2b89eb9">tempest-VolumesAdminNegativeTest-1117550447-project-member</nova:user>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:project uuid="371ee6c1bd154750aa942c3b582d2bda">tempest-VolumesAdminNegativeTest-1117550447</nova:project>
Jul 27 12:39:52 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:39:52 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:52 user nova-compute[70994]:         <nova:port uuid="294180fe-682a-4cae-89ad-834369b928a5">
Jul 27 12:39:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:39:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:52 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:52 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:52 user nova-compute[70994]:   </metadata>
Jul 27 12:39:52 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:52 user nova-compute[70994]:     <system>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="serial">5d2440a0-860c-4700-9fed-224851bec304</entry>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="uuid">5d2440a0-860c-4700-9fed-224851bec304</entry>
Jul 27 12:39:52 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:52 user nova-compute[70994]:     </system>
Jul 27 12:39:52 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:52 user nova-compute[70994]:   <os>
Jul 27 12:39:52 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:52 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:52 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:52 user nova-compute[70994]:   </os>
Jul 27 12:39:52 user nova-compute[70994]:   <features>
Jul 27 12:39:52 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:52 user nova-compute[70994]:     <apic/>
Jul 27 12:39:52 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:52 user nova-compute[70994]:   </features>
Jul 27 12:39:52 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:52 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:52 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:52 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:52 user nova-compute[70994]:   </clock>
Jul 27 12:39:52 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:52 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:52 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:52 user nova-compute[70994]:   </cpu>
Jul 27 12:39:52 user nova-compute[70994]:   <devices>
Jul 27 12:39:52 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:52 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:52 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk"/>
Jul 27 12:39:52 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:39:52 user nova-compute[70994]:     </disk>
Jul 27 12:39:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:52 user nova-compute[70994]:       <mac address="fa:16:3e:47:77:db"/>
Jul 27 12:39:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:52 user nova-compute[70994]:       <target dev="tap294180fe-68"/>
Jul 27 12:39:52 user nova-compute[70994]:     </interface>
Jul 27 12:39:52 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:52 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/console.log" append="off"/>
Jul 27 12:39:52 user nova-compute[70994]:     </serial>
Jul 27 12:39:52 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:52 user nova-compute[70994]:     <video>
Jul 27 12:39:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:52 user nova-compute[70994]:     </video>
Jul 27 12:39:52 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:52 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:52 user nova-compute[70994]:     </rng>
Jul 27 12:39:52 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:52 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:52 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:52 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:52 user nova-compute[70994]:   </devices>
Jul 27 12:39:52 user nova-compute[70994]: </domain>
Jul 27 12:39:52 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1207065891',display_name='tempest-VolumesAdminNegativeTest-server-1207065891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1207065891',id=10,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChSrArlyDyBzqE0UhpVHUqG8g7uIRb2KXcSzfBb8dWjE5kCJKLtHKiinEuPDCECKYhLhv0z8uKZpaSed5bUqGErXHTCnUAoXzp2gR9rpuS97KU2qs29zaVzFG5qWSJSpA==',key_name='tempest-keypair-188592589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-3chme8oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=5d2440a0-860c-4700-9fed-224851bec304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG os_vif [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap294180fe-68, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap294180fe-68, col_values=(('external_ids', {'iface-id': '294180fe-682a-4cae-89ad-834369b928a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:77:db', 'vm-uuid': '5d2440a0-860c-4700-9fed-224851bec304'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:52 user nova-compute[70994]: INFO os_vif [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68')
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Successfully updated port: 5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquired lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No VIF found with MAC fa:16:3e:47:77:db, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-changed-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Refreshing instance network info cache due to event network-changed-5a0a980b-1231-42d9-9799-984ef056eb33. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] Acquiring lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] No waiting events found dispatching network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:52 user nova-compute[70994]: WARNING nova.compute.manager [req-e6095fb6-10bf-4041-9a72-adcd3b052e31 req-32990353-cb59-4c15-b1e9-787680c728b7 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received unexpected event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab for instance with vm_state building and task_state spawning.
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating instance_info_cache with network_info: [{"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Releasing lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Instance network_info: |[{"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] Acquired lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Refreshing network info cache for port 5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Start _get_guest_xml network_info=[{"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:39:36Z,direct_url=<?>,disk_format='qcow2',id=7ee54a31-b3d3-42df-9e6e-5f6862bb27cf,min_disk=0,min_ram=0,name='',owner='44a87cc427074719915ee792cb037e86',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:39:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'scsi', 'image_id': '7ee54a31-b3d3-42df-9e6e-5f6862bb27cf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:39:53 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:53 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:39:36Z,direct_url=<?>,disk_format='qcow2',id=7ee54a31-b3d3-42df-9e6e-5f6862bb27cf,min_disk=0,min_ram=0,name='',owner='44a87cc427074719915ee792cb037e86',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:39:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1892611148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1892611148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1892611148',id=11,image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOxWDq/QyVSj+WzV59OS6qYdS7uL3f+xsY/HrWbEFzT/rBrwyr+D4hdqW1901J5baYUHIp47PN0j6f6W0jaxR26QFlXpymIe2OlW+BviPQCSS36cju8Jb/8N+34icMJsQ==',key_name='tempest-keypair-1951567509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69fffed844249eb87e5f73f4fc862c0',ramdisk_id='',reservation_id='r-shru7umq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1475755362',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1475755362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3857a4640c4ae4a30c3ea57735e23c',uuid=d18149ad-4761-4986-9ccf-199b3ef176ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converting VIF {"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.objects.instance [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'pci_devices' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:39:53 user nova-compute[70994]:   <uuid>d18149ad-4761-4986-9ccf-199b3ef176ae</uuid>
Jul 27 12:39:53 user nova-compute[70994]:   <name>instance-0000000b</name>
Jul 27 12:39:53 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:39:53 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:39:53 user nova-compute[70994]:   <metadata>
Jul 27 12:39:53 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:39:53 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1892611148</nova:name>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:39:53</nova:creationTime>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:39:53 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:39:53 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:owner>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:user uuid="3d3857a4640c4ae4a30c3ea57735e23c">tempest-AttachSCSIVolumeTestJSON-1475755362-project-member</nova:user>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:project uuid="c69fffed844249eb87e5f73f4fc862c0">tempest-AttachSCSIVolumeTestJSON-1475755362</nova:project>
Jul 27 12:39:53 user nova-compute[70994]:       </nova:owner>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:root type="image" uuid="7ee54a31-b3d3-42df-9e6e-5f6862bb27cf"/>
Jul 27 12:39:53 user nova-compute[70994]:       <nova:ports>
Jul 27 12:39:53 user nova-compute[70994]:         <nova:port uuid="5a0a980b-1231-42d9-9799-984ef056eb33">
Jul 27 12:39:53 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 12:39:53 user nova-compute[70994]:         </nova:port>
Jul 27 12:39:53 user nova-compute[70994]:       </nova:ports>
Jul 27 12:39:53 user nova-compute[70994]:     </nova:instance>
Jul 27 12:39:53 user nova-compute[70994]:   </metadata>
Jul 27 12:39:53 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:39:53 user nova-compute[70994]:     <system>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="serial">d18149ad-4761-4986-9ccf-199b3ef176ae</entry>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="uuid">d18149ad-4761-4986-9ccf-199b3ef176ae</entry>
Jul 27 12:39:53 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:39:53 user nova-compute[70994]:     </system>
Jul 27 12:39:53 user nova-compute[70994]:   </sysinfo>
Jul 27 12:39:53 user nova-compute[70994]:   <os>
Jul 27 12:39:53 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:39:53 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:39:53 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:39:53 user nova-compute[70994]:   </os>
Jul 27 12:39:53 user nova-compute[70994]:   <features>
Jul 27 12:39:53 user nova-compute[70994]:     <acpi/>
Jul 27 12:39:53 user nova-compute[70994]:     <apic/>
Jul 27 12:39:53 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:39:53 user nova-compute[70994]:   </features>
Jul 27 12:39:53 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:39:53 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:39:53 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:39:53 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:39:53 user nova-compute[70994]:   </clock>
Jul 27 12:39:53 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:39:53 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:39:53 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:39:53 user nova-compute[70994]:   </cpu>
Jul 27 12:39:53 user nova-compute[70994]:   <devices>
Jul 27 12:39:53 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:39:53 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:39:53 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk"/>
Jul 27 12:39:53 user nova-compute[70994]:       <target dev="sda" bus="scsi"/>
Jul 27 12:39:53 user nova-compute[70994]:       <address type="drive" controller="0" unit="0"/>
Jul 27 12:39:53 user nova-compute[70994]:     </disk>
Jul 27 12:39:53 user nova-compute[70994]:     <disk type="file" device="cdrom">
Jul 27 12:39:53 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 12:39:53 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.config"/>
Jul 27 12:39:53 user nova-compute[70994]:       <target dev="sdb" bus="scsi"/>
Jul 27 12:39:53 user nova-compute[70994]:       <address type="drive" controller="0" unit="1"/>
Jul 27 12:39:53 user nova-compute[70994]:     </disk>
Jul 27 12:39:53 user nova-compute[70994]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 27 12:39:53 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:39:53 user nova-compute[70994]:       <mac address="fa:16:3e:5d:5c:d7"/>
Jul 27 12:39:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:53 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:39:53 user nova-compute[70994]:       <target dev="tap5a0a980b-12"/>
Jul 27 12:39:53 user nova-compute[70994]:     </interface>
Jul 27 12:39:53 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:39:53 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/console.log" append="off"/>
Jul 27 12:39:53 user nova-compute[70994]:     </serial>
Jul 27 12:39:53 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:39:53 user nova-compute[70994]:     <video>
Jul 27 12:39:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:39:53 user nova-compute[70994]:     </video>
Jul 27 12:39:53 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:39:53 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:39:53 user nova-compute[70994]:     </rng>
Jul 27 12:39:53 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:39:53 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:39:53 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:39:53 user nova-compute[70994]:     </memballoon>
Jul 27 12:39:53 user nova-compute[70994]:   </devices>
Jul 27 12:39:53 user nova-compute[70994]: </domain>
Jul 27 12:39:53 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1892611148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1892611148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1892611148',id=11,image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOxWDq/QyVSj+WzV59OS6qYdS7uL3f+xsY/HrWbEFzT/rBrwyr+D4hdqW1901J5baYUHIp47PN0j6f6W0jaxR26QFlXpymIe2OlW+BviPQCSS36cju8Jb/8N+34icMJsQ==',key_name='tempest-keypair-1951567509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69fffed844249eb87e5f73f4fc862c0',ramdisk_id='',reservation_id='r-shru7umq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1475755362',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1475755362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3857a4640c4ae4a30c3ea57735e23c',uuid=d18149ad-4761-4986-9ccf-199b3ef176ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converting VIF {"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG os_vif [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a0a980b-12, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a0a980b-12, col_values=(('external_ids', {'iface-id': '5a0a980b-1231-42d9-9799-984ef056eb33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:5c:d7', 'vm-uuid': 'd18149ad-4761-4986-9ccf-199b3ef176ae'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: INFO os_vif [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12')
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No BDM found with device name sda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No VIF found with MAC fa:16:3e:5d:5c:d7, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:39:53 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Using config drive
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updated VIF entry in instance network info cache for port 5a0a980b-1231-42d9-9799-984ef056eb33. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating instance_info_cache with network_info: [{"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:39:53 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Creating config drive at /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.config
Jul 27 12:39:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiryvt4r3 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d9c370-732a-40d0-b5a1-9c8cc4eaf7e5 req-c88e6c0d-8cb5-4f70-8065-fc5c59f17c26 service nova] Releasing lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiryvt4r3" returned: 0 in 0.078s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] No waiting events found dispatching network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:54 user nova-compute[70994]: WARNING nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received unexpected event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab for instance with vm_state building and task_state spawning.
Jul 27 12:39:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] No waiting events found dispatching network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:54 user nova-compute[70994]: WARNING nova.compute.manager [req-f62be330-0a84-4a71-8040-4c9c13694fc4 req-f240813a-bfed-4176-8ccf-4e3e53ce8cb6 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received unexpected event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 for instance with vm_state building and task_state spawning.
Jul 27 12:39:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461595.9015923, 662c50c8-4f10-4cc1-b537-cf31dde13cca => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:55 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] VM Resumed (Lifecycle Event)
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Instance spawned successfully.
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:56 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461595.901754, 662c50c8-4f10-4cc1-b537-cf31dde13cca => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:56 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] VM Started (Lifecycle Event)
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:56 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:56 user nova-compute[70994]: INFO nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Took 9.91 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:56 user nova-compute[70994]: INFO nova.compute.manager [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Took 11.52 seconds to build instance.
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4fdd0335-3905-4fa4-91cb-b136d259dacf tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.867s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] No waiting events found dispatching network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:56 user nova-compute[70994]: WARNING nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received unexpected event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 for instance with vm_state building and task_state spawning.
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] No waiting events found dispatching network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:56 user nova-compute[70994]: WARNING nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received unexpected event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 for instance with vm_state building and task_state spawning.
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] No waiting events found dispatching network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:39:56 user nova-compute[70994]: WARNING nova.compute.manager [req-5fdfa69d-6e72-451c-a3c4-b7a0c204904d req-9ca7aaf9-567b-4262-a695-63d1e5f61816 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received unexpected event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 for instance with vm_state building and task_state spawning.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461598.504919, 5d2440a0-860c-4700-9fed-224851bec304 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] VM Resumed (Lifecycle Event)
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance spawned successfully.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461598.5079358, 5d2440a0-860c-4700-9fed-224851bec304 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] VM Started (Lifecycle Event)
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Instance spawned successfully.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461598.608786, d18149ad-4761-4986-9ccf-199b3ef176ae => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] VM Resumed (Lifecycle Event)
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Took 10.96 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Took 9.20 seconds to spawn the instance on the hypervisor.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461598.6096811, d18149ad-4761-4986-9ccf-199b3ef176ae => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] VM Started (Lifecycle Event)
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:39:58 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Took 13.41 seconds to build instance.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-54679eda-62f3-4606-8f00-b0cc0d7689be tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.604s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:39:58 user nova-compute[70994]: INFO nova.compute.manager [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Took 10.82 seconds to build instance.
Jul 27 12:39:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-23475fee-bd7f-43b0-83a1-e76050fbe7a2 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.160s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:40:22 user nova-compute[70994]: INFO nova.compute.claims [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Claim successful on node user
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:40:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:40:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:40:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:40:23 user nova-compute[70994]: INFO nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Booting with volume 2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 at /dev/vda
Jul 27 12:40:23 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:23 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpioiloepg/privsep.sock']
Jul 27 12:40:23 user sudo[82462]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpioiloepg/privsep.sock
Jul 27 12:40:23 user sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 12:40:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:23 user nova-compute[70994]: DEBUG nova.policy [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7fcfe35145a46e28da123047cccddd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0a7eb226524d17aa02c7f0d35be501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:40:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully created port: 8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:24 user sudo[82462]: pam_unix(sudo:session): session closed for user root
Jul 27 12:40:24 user nova-compute[70994]: INFO oslo.privsep.daemon [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Spawned new privsep daemon via rootwrap
Jul 27 12:40:24 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 12:40:24 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 12:40:24 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 27 12:40:24 user nova-compute[70994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82465
Jul 27 12:40:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11110519-cda7-4b36-b2c2-85980c9ef7ce]: (2,) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully created port: 16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced970be-74fb-4f67-a49f-2a5e70a3ca29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:25 user nova-compute[70994]: WARNING os_brick.initiator.connectors.nvmeof [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d4f273-411c-47c3-87df-8db0c482813f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9fc32-3910-45e0-9471-66e34844ba90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc3c986-0d0b-4d75-b03b-fc53b787358e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:25 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a573679-f2a2-4fc0-a719-3c514edfce77]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== get_connector_properties: return (1911ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating existing volume attachment record: 3f817fd7-9792-4047-ae31-ee1bd2fcff04 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Skipping network cache update for instance because it is Building. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lazy-loading 'info_cache' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:40:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully created port: 6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:40:26 user nova-compute[70994]: INFO nova.compute.claims [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Claim successful on node user
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:40:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully created port: 7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:26 user nova-compute[70994]: INFO nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Booting with volume 028cbbd8-dfd7-451a-9604-39c350d0edd8 at /dev/vda
Jul 27 12:40:26 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[716897bf-65ca-453f-93ca-ad7f4dabe185]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a3c36-6be8-4c6e-9de7-f20c7c4c7210]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf5179-7221-4c60-8cab-53e75edf0450]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc910b15-2f1b-4e84-a954-9714b2af1779]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:27 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e5a998-6d3e-46bb-b827-d1474cb50c8b]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating existing volume attachment record: 957eda35-8efb-4b1f-837f-41bea76b77c4 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG nova.policy [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a965dc4584244ec2b2c577799bf79f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cb33350f040b3b248a84b3746235e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:27 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully created port: ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully created port: f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully created port: 3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-8b14d748-e776-4d6f-87d7-64d82f9fd27a. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-98a01641-0b8f-4ea1-9a16-f2fcc1d2d060 req-281bca01-aa80-453a-9084-6a97304d973c service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully created port: 92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:31 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:31 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=6600MB free_disk=25.73553466796875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 953c1df6-c793-4181-a52b-8c5da4256afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 662c50c8-4f10-4cc1-b537-cf31dde13cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance d18149ad-4761-4986-9ccf-199b3ef176ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance c7fb777c-fae8-438d-a339-478ed2f8cb49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-657dedfb-d8e8-4675-856c-dc0bbd13a2e1. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8c17e825-2193-453d-9a6b-5dae1b7c1104 req-2ee25f53-05ae-44ec-b2d0-7d7191dc0d78 service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully created port: ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:32 user nova-compute[70994]: INFO nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Booting with volume a057cc88-75fb-4c68-9e85-13bcd989e549 at /dev/vdb
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7290a-2a03-4d2d-b5d4-7352deb32d10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4aab7-841e-457f-9ae3-9869b6a19c5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad84651-f909-43b6-99e8-08d2dbb5f591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[922761de-a83b-4dba-9a0b-550a5eacf479]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:32 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a830b-2d5f-4de4-b622-4d0f1d7e8303]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating existing volume attachment record: 4fcf98c6-bc20-4a6a-9a59-79b306f575c3 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:40:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully created port: bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-48fc0163-4e5a-4ffc-915e-25f8482d78a1. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9889e01-c0bf-4574-91d2-33672487745c req-fd7cd10e-3d66-43d2-a3f2-cf69c99fb26d service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:34 user nova-compute[70994]: INFO nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Booting with volume df9ccaa0-8458-4f71-a2d6-0378048a2b0d at /dev/vdb
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6095b55-a65d-46fa-b5b3-ad9769024ff7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f954b8d-4d39-468b-967b-c2d10c5691b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a77828-e8b1-4a51-ae1b-d2f08a900315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d1ffd-60b5-4f6c-a845-24ba4b753a5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:34 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:34 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d800e6-bce8-4a9c-ad2d-405b39a2e4fe]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating existing volume attachment record: 95cf598a-3379-4947-b5a0-d7484e36dcf2 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:34 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:35 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-16c11948-6864-466d-ac7e-b7d87c0057aa. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-f8924976-f987-42b4-a080-b635ce4fefc3. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9584a286-4e29-49da-a810-f41f71b0d800 req-4cd64fc8-814b-4913-b4d7-91064dfdacd3 service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:37 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: 9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-6983ee02-7d34-4cff-a7be-8aaf2352b907. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: 7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-9ee9b8be-fb27-4677-924e-038b96735a35. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port 9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9bad6481-711a-4fdb-a675-209d4132ebc3 req-b28fdb20-75aa-40ca-8850-0829cebbb230 service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:39 user nova-compute[70994]: INFO nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Booting with volume 61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 at /dev/vdc
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9662c-0609-4d26-acf9-5d6de403644a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087423d-5783-4c5c-a8e9-5557eedfb46f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9effb-d900-4c95-b464-1b014f240ba5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e062e-3dcc-49a1-b1e3-0e49aa5e3d2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:39 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a3cf5-9cd3-4209-92d0-0dc8d99d52fa]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG os_brick.utils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating existing volume attachment record: b2189040-f737-40d7-894c-d9d236f970cf {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Successfully updated port: ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:40:40 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:40 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:40 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:40 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: 3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:41 user nova-compute[70994]: INFO nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Booting with volume 4c55f37e-1dd1-4970-99b3-8f4d73a62f88 at /dev/vdc
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcdbda8-573e-4264-be8d-6af2448cbf89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2ffd0-537e-4827-9d9d-daefc1f6a695]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87a77c2-38b2-4081-a030-55108b2fbbe8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc9382-a7fe-4864-aae7-bccebcd33d2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:40:41 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:40:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897c89c-6880-43dc-9cde-c6c3ae8cd40b]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG os_brick.utils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:41 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating existing volume attachment record: bfc898ad-916c-4096-8f16-1a4150e2c692 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-3b3e3584-994e-440b-81b3-1d6a5fc98923. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port 3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: 92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-964adf39-aab6-499d-bc2d-fc475d1db284 req-99a158d9-b55a-4871-98bb-708572be8dac service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance network_info: |[{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:43 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port 92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updated VIF entry in instance network info cache for port 7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-d657fe94-5dfc-4f2b-b23a-f13056d986c1. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a92309c-79c8-483d-bb42-b3eb8eb461c7 req-7485ec04-84ab-4495-9311-fe77a2f259af service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:44 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Successfully updated port: bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-ef1461ee-5288-4255-be42-001889dccbd5. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:40:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updated VIF entry in instance network info cache for port ef1461ee-5288-4255-be42-001889dccbd5. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-60798d22-82ff-4260-9998-16e4d79f64af req-8de2e356-b849-43d1-9c47-68c63c3e82b4 service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-bc495d56-5cc3-4e23-b0c8-7a18b582df31. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:40:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Creating image(s)
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Ensure instance console log exists: /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Start _get_guest_xml network_info=[{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMIVaXug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c', 'attached_at': '', 'detached_at': '', 'volume_id': '2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 'serial': '2a75505b-c2d4-4ffb-8b99-f2a9b423eb96'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '3f817fd7-9792-4047-ae31-ee1bd2fcff04', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'einVrplB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a057cc88-75fb-4c68-9e85-13bcd989e549', 'serial': 'a057cc88-75fb-4c68-9e85-13bcd989e549'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '4fcf98c6-bc20-4a6a-9a59-79b306f575c3', 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPIpmqLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c', 'attached_at': '', 'detached_at': '', 'volume_id': '61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 'serial': '61d502b2-09fc-4bba-82e4-d4fa62bcf0c9'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'b2189040-f737-40d7-894c-d9d236f970cf', 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:40:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connector [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Factory for ISCSI on None {{(pid=70994) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMIVaXug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:47 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:47 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:47 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bc4b2-492f-4fd1-973e-50e030750e7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:47 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936dde8-46c8-4e2f-a971-e674dab63235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96] added
Jul 27 12:40:47 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b8079-946d-48c5-aae7-eba82cfdaf9c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9eebde-0033-4b0e-a803-4cecb271f247]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMIVaXug {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMIVaXug" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9017fa62-6b27-4051-b2cf-570d3f43026a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMIVaXug'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0327f-ddb9-48d9-b147-9a841fcb8184]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f5ae21-9b10-44a6-ab6c-e6dd0ffa836c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 12:40:47 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 12:40:47 user nova-compute[70994]:  {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:47 user nova-compute[70994]: WARNING os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 12:40:47 user nova-compute[70994]: 
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance network_info: |[{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a86061b-67fb-49d5-ab35-b7ea0d634224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260]
Jul 27 12:40:47 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:47 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b5b88-840b-4023-9884-4421d7adc242]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e597526-79fb-42e4-bdad-b47a15d3213b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:47 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:47 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6db7fc6-ef24-4303-bd20-d319c0e3c8e8]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMIVaXug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updated VIF entry in instance network info cache for port bc495d56-5cc3-4e23-b0c8-7a18b582df31. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:40:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-43b824fb-819a-4f22-a639-b65246b7a14c req-98de7f05-2dbc-4953-a967-08aa546cb159 service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23630623737663132', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630623737663132', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'einVrplB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:48 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:48 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:48 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c94a15-3d2d-4809-8b0e-d777ed9a248f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:48 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:40:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Creating image(s)
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Ensure instance console log exists: /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Start _get_guest_xml network_info=[{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCaDfOIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7fb777c-fae8-438d-a339-478ed2f8cb49', 'attached_at': '', 'detached_at': '', 'volume_id': '028cbbd8-dfd7-451a-9604-39c350d0edd8', 'serial': '028cbbd8-dfd7-451a-9604-39c350d0edd8'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '957eda35-8efb-4b1f-837f-41bea76b77c4', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsDGFMmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7fb777c-fae8-438d-a339-478ed2f8cb49', 'attached_at': '', 'detached_at': '', 'volume_id': 'df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 'serial': 'df9ccaa0-8458-4f71-a2d6-0378048a2b0d'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '95cf598a-3379-4947-b5a0-d7484e36dcf2', 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWKVXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7fb777c-fae8-438d-a339-478ed2f8cb49', 'attached_at': '', 'detached_at': '', 'volume_id': '4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 'serial': '4c55f37e-1dd1-4970-99b3-8f4d73a62f88'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'bfc898ad-916c-4096-8f16-1a4150e2c692', 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1ca64-454f-414b-9fb0-8e1bb8b787a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549] added
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCaDfOIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:48 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef4ef1-732b-4a97-b983-438ffd4770f3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f6a5d-f983-4c66-99c3-c328763c0d21]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v einVrplB {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v einVrplB" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49adcc-34b4-411d-9bd4-318352e2d3d4]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'einVrplB'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a3845-5a3a-4d35-819d-480e8fb06f7f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa8c25-b433-4ac6-b23f-9ee4aebcf7f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42faa4eb-aa7f-4a8c-beb0-6a22f8342b06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260]
Jul 27 12:40:48 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[693263f9-7de1-4654-b59a-5af2abf55533]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8757df-d627-4d4c-b4e7-bd9c0662c828]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b892177-c208-4f01-b591-0dd2b6b0d7f0]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:49 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'einVrplB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23064623639343531', 'path': '/dev/sdc'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064623639343531', 'path': '/dev/sdc'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.238s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:50 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:50 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc2b49-b1ff-4daf-9a1d-aa8d84f3e1f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:50 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPIpmqLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:50 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[335464f5-aed9-466e-aa4d-2470dd429ecb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8] added
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc57c14-7716-430f-b082-543297a0cef1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e133746-7bf3-4a7b-96fc-a2add0410885]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCaDfOIj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCaDfOIj" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf52e88-b4dd-48af-a314-4d6b47508a08]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCaDfOIj'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd4bdbf-c67c-434d-8340-2edd2ff40fde]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73831b-2e36-4ca8-aaae-1bf60fe88870]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9047e6-bcb7-4225-a8ae-80cf5940d86a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260]
Jul 27 12:40:50 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8c134-7dba-4075-9d38-0a6e87354316]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd95cb1-981c-4f27-aad0-495dc41022c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b07e1-fca3-4c9a-beab-44323fab4f86]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCaDfOIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== connect_volume: return (2539ms) {'type': 'block', 'scsi_wwn': '23330613836393866', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330613836393866', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.271s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:51 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131835b-2740-4025-a3b2-5af462b3a4ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:51 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsDGFMmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20780222-de7b-4c1d-bdf3-4249dcabdbe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9] added
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc46ed4b-5404-4679-99c2-2661940c067a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc163139-b184-4571-9a08-f202ca036b6c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPIpmqLY {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPIpmqLY" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b7395a-fd41-4fd9-bdde-479ab50250c3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPIpmqLY'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[399bc1fd-6a19-4e47-a7d7-acec262f7b8a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503e5a6-7df1-4bbc-9864-f99ce46016a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4c904-a4a6-4ee1-9262-6bc85d41bda3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260]
Jul 27 12:40:51 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[850291e2-c0af-4420-b325-1a93549ad5e5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bcee9a-0e3e-43b4-8004-622295fc2f37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf558a8f-11f0-435a-94ad-06082da4b30e]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPIpmqLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== connect_volume: return (2566ms) {'type': 'block', 'scsi_wwn': '26364633465323338', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364633465323338', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.269s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:52 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[748af017-323e-46ee-8a5b-71f05223c2a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lazy-loading 'pci_devices' on Instance uuid b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:52 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:40:52 user nova-compute[70994]:   <uuid>b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c</uuid>
Jul 27 12:40:52 user nova-compute[70994]:   <name>instance-0000000c</name>
Jul 27 12:40:52 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:40:52 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:40:52 user nova-compute[70994]:   <metadata>
Jul 27 12:40:52 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:40:52 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:name>tempest-device-tagging-server-421700455</nova:name>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:40:47</nova:creationTime>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:40:52 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:40:52 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:owner>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:user uuid="f7fcfe35145a46e28da123047cccddd8">tempest-TaggedBootDevicesTest-1690118915-project-member</nova:user>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:project uuid="2b0a7eb226524d17aa02c7f0d35be501">tempest-TaggedBootDevicesTest-1690118915</nova:project>
Jul 27 12:40:52 user nova-compute[70994]:       </nova:owner>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:40:52 user nova-compute[70994]:       <nova:ports>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="8b14d748-e776-4d6f-87d7-64d82f9fd27a">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="657dedfb-d8e8-4675-856c-dc0bbd13a2e1">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="48fc0163-4e5a-4ffc-915e-25f8482d78a1">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="16c11948-6864-466d-ac7e-b7d87c0057aa">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="6983ee02-7d34-4cff-a7be-8aaf2352b907">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.159" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:         <nova:port uuid="ef1461ee-5288-4255-be42-001889dccbd5">
Jul 27 12:40:52 user nova-compute[70994]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 12:40:52 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:52 user nova-compute[70994]:       </nova:ports>
Jul 27 12:40:52 user nova-compute[70994]:     </nova:instance>
Jul 27 12:40:52 user nova-compute[70994]:   </metadata>
Jul 27 12:40:52 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:40:52 user nova-compute[70994]:     <system>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="serial">b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c</entry>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="uuid">b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c</entry>
Jul 27 12:40:52 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:40:52 user nova-compute[70994]:     </system>
Jul 27 12:40:52 user nova-compute[70994]:   </sysinfo>
Jul 27 12:40:52 user nova-compute[70994]:   <os>
Jul 27 12:40:52 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:40:52 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:40:52 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:40:52 user nova-compute[70994]:   </os>
Jul 27 12:40:52 user nova-compute[70994]:   <features>
Jul 27 12:40:52 user nova-compute[70994]:     <acpi/>
Jul 27 12:40:52 user nova-compute[70994]:     <apic/>
Jul 27 12:40:52 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:40:52 user nova-compute[70994]:   </features>
Jul 27 12:40:52 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:40:52 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:40:52 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:40:52 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:40:52 user nova-compute[70994]:   </clock>
Jul 27 12:40:52 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:40:52 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:40:52 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:40:52 user nova-compute[70994]:   </cpu>
Jul 27 12:40:52 user nova-compute[70994]:   <devices>
Jul 27 12:40:52 user nova-compute[70994]:     <disk type="file" device="cdrom">
Jul 27 12:40:52 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 12:40:52 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/disk.config"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="hda" bus="ide"/>
Jul 27 12:40:52 user nova-compute[70994]:     </disk>
Jul 27 12:40:52 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:52 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:52 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <serial>2a75505b-c2d4-4ffb-8b99-f2a9b423eb96</serial>
Jul 27 12:40:52 user nova-compute[70994]:     </disk>
Jul 27 12:40:52 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:52 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:52 user nova-compute[70994]:       <source dev="/dev/sdc"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <serial>a057cc88-75fb-4c68-9e85-13bcd989e549</serial>
Jul 27 12:40:52 user nova-compute[70994]:     </disk>
Jul 27 12:40:52 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:52 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:52 user nova-compute[70994]:       <source dev="/dev/sde"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="vdc" bus="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <serial>61d502b2-09fc-4bba-82e4-d4fa62bcf0c9</serial>
Jul 27 12:40:52 user nova-compute[70994]:     </disk>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:01:75:3b"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap8b14d748-e7"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:70:09:d6"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap657dedfb-d8"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:d5:bc:04"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap48fc0163-4e"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:36:be:2c"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap16c11948-68"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:39:8e:10"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap6983ee02-7d"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:38:ad:11"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tap7f8314f9-df"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:52 user nova-compute[70994]:       <mac address="fa:16:3e:c9:d5:50"/>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:52 user nova-compute[70994]:       <target dev="tapef1461ee-52"/>
Jul 27 12:40:52 user nova-compute[70994]:     </interface>
Jul 27 12:40:52 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:40:52 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/console.log" append="off"/>
Jul 27 12:40:52 user nova-compute[70994]:     </serial>
Jul 27 12:40:52 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:40:52 user nova-compute[70994]:     <video>
Jul 27 12:40:52 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:52 user nova-compute[70994]:     </video>
Jul 27 12:40:52 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:40:52 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:40:52 user nova-compute[70994]:     </rng>
Jul 27 12:40:52 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:40:52 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:40:52 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:40:52 user nova-compute[70994]:     </memballoon>
Jul 27 12:40:52 user nova-compute[70994]:   </devices>
Jul 27 12:40:52 user nova-compute[70994]: </domain>
Jul 27 12:40:52 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b2038-f269-47e6-8477-54c8a6aea736]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d] added
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b14d748-e7, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b14d748-e7, col_values=(('external_ids', {'iface-id': '8b14d748-e776-4d6f-87d7-64d82f9fd27a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:75:3b', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc53094-004f-4dda-9902-343b568213f1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap657dedfb-d8, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap657dedfb-d8, col_values=(('external_ids', {'iface-id': '657dedfb-d8e8-4675-856c-dc0bbd13a2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:09:d6', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69599ab4-c2e8-4b61-9649-b4edf6fb88a1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsDGFMmg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48fc0163-4e, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48fc0163-4e, col_values=(('external_ids', {'iface-id': '48fc0163-4e5a-4ffc-915e-25f8482d78a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:bc:04', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NsDGFMmg" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d380f-7071-498c-8ebd-3bebb19f2329]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NsDGFMmg'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c11948-68, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16c11948-68, col_values=(('external_ids', {'iface-id': '16c11948-6864-466d-ac7e-b7d87c0057aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:be:2c', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2e4ab-1655-4849-ab40-068ed6ae8c99]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af0a62-f592-4732-b0e3-856a7f46967f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6983ee02-7d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6983ee02-7d, col_values=(('external_ids', {'iface-id': '6983ee02-7d34-4cff-a7be-8aaf2352b907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:8e:10', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f8314f9-df, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f8314f9-df, col_values=(('external_ids', {'iface-id': '7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ad:11', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e750f4-8a81-4b3d-9d86-4c2d6b57314f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260]
Jul 27 12:40:52 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9cac1-54cf-4c41-a70b-a46f65cb44db]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df')
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b193bce-8b45-4ee2-85a3-a79e083287d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:52 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1461ee-52, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef1461ee-52, col_values=(('external_ids', {'iface-id': 'ef1461ee-5288-4255-be42-001889dccbd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:d5:50', 'vm-uuid': 'b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f52d4b-238b-4d70-809b-b689fdbf51b9]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsDGFMmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:53 user nova-compute[70994]: INFO os_vif [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52')
Jul 27 12:40:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] No BDM found with device name hda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] No VIF found with MAC fa:16:3e:01:75:3b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] No VIF found with MAC fa:16:3e:39:8e:10, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:40:53 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Using config drive
Jul 27 12:40:53 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Creating config drive at /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/disk.config
Jul 27 12:40:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyy8s4dsp {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyy8s4dsp" returned: 0 in 0.054s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== connect_volume: return (2670ms) {'type': 'block', 'scsi_wwn': '26138613762356135', 'path': '/dev/sdf'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138613762356135', 'path': '/dev/sdf'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWKVXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:40:54 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:54 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:40:54 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2322a-2f9b-48b8-b4a8-387c257e41ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:40:54 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11da77-e126-44b2-9fd7-ff4f14c8721c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88] added
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091c5e6-4189-4847-ad74-c8842483c659]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3489b3-e962-416e-b944-59561ea42544]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQWKVXLx {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQWKVXLx" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88678279-0521-4639-a548-16df2b7bdbde]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQWKVXLx'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb8e09-3696-47f1-b43d-c1b6286b04dd]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09199fd3-78fd-4e4e-a915-26f22b25eb43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3337d9dd-16b2-4c99-8a71-e9093172dadd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260]
Jul 27 12:40:54 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260] successful.
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42dff3-a925-4a3a-b60c-f70756cde7af]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f749dc-3870-43ac-bdc5-6b80d2e83485]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:40:54 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:40:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70181d-edad-49c8-8ee1-cf1966ae2cb0]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWKVXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:55 user nova-compute[70994]: WARNING nova.compute.manager [req-2dc445eb-2ec1-49ad-861c-16fe0871e369 req-3d5da714-9e6c-4233-8546-2f9a59073d4c service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a for instance with vm_state building and task_state spawning.
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23634663439346565', 'path': '/dev/sdg'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663439346565', 'path': '/dev/sdg'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.objects.instance [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lazy-loading 'pci_devices' on Instance uuid c7fb777c-fae8-438d-a339-478ed2f8cb49 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:40:55 user nova-compute[70994]:   <uuid>c7fb777c-fae8-438d-a339-478ed2f8cb49</uuid>
Jul 27 12:40:55 user nova-compute[70994]:   <name>instance-0000000d</name>
Jul 27 12:40:55 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:40:55 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:40:55 user nova-compute[70994]:   <metadata>
Jul 27 12:40:55 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:40:55 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:name>tempest-device-tagging-server-1478542775</nova:name>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:40:48</nova:creationTime>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:40:55 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:40:55 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:owner>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:user uuid="a965dc4584244ec2b2c577799bf79f19">tempest-TaggedBootDevicesTest_v242-409814752-project-member</nova:user>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:project uuid="e11cb33350f040b3b248a84b3746235e">tempest-TaggedBootDevicesTest_v242-409814752</nova:project>
Jul 27 12:40:55 user nova-compute[70994]:       </nova:owner>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:40:55 user nova-compute[70994]:       <nova:ports>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="f8924976-f987-42b4-a080-b635ce4fefc3">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="9ee9b8be-fb27-4677-924e-038b96735a35">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.21" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="d657fe94-5dfc-4f2b-b23a-f13056d986c1">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="3b3e3584-994e-440b-81b3-1d6a5fc98923">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="92b87fcb-1b9b-45d7-bcd9-b71f78b22b49">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="ef56aaf1-08ae-49d6-b8a3-296ebc3ca309">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:         <nova:port uuid="bc495d56-5cc3-4e23-b0c8-7a18b582df31">
Jul 27 12:40:55 user nova-compute[70994]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 12:40:55 user nova-compute[70994]:         </nova:port>
Jul 27 12:40:55 user nova-compute[70994]:       </nova:ports>
Jul 27 12:40:55 user nova-compute[70994]:     </nova:instance>
Jul 27 12:40:55 user nova-compute[70994]:   </metadata>
Jul 27 12:40:55 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:40:55 user nova-compute[70994]:     <system>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="serial">c7fb777c-fae8-438d-a339-478ed2f8cb49</entry>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="uuid">c7fb777c-fae8-438d-a339-478ed2f8cb49</entry>
Jul 27 12:40:55 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:40:55 user nova-compute[70994]:     </system>
Jul 27 12:40:55 user nova-compute[70994]:   </sysinfo>
Jul 27 12:40:55 user nova-compute[70994]:   <os>
Jul 27 12:40:55 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:40:55 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:40:55 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:40:55 user nova-compute[70994]:   </os>
Jul 27 12:40:55 user nova-compute[70994]:   <features>
Jul 27 12:40:55 user nova-compute[70994]:     <acpi/>
Jul 27 12:40:55 user nova-compute[70994]:     <apic/>
Jul 27 12:40:55 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:40:55 user nova-compute[70994]:   </features>
Jul 27 12:40:55 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:40:55 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:40:55 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:40:55 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:40:55 user nova-compute[70994]:   </clock>
Jul 27 12:40:55 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:40:55 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:40:55 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:40:55 user nova-compute[70994]:   </cpu>
Jul 27 12:40:55 user nova-compute[70994]:   <devices>
Jul 27 12:40:55 user nova-compute[70994]:     <disk type="file" device="cdrom">
Jul 27 12:40:55 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 12:40:55 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/disk.config"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="hda" bus="ide"/>
Jul 27 12:40:55 user nova-compute[70994]:     </disk>
Jul 27 12:40:55 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:55 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:55 user nova-compute[70994]:       <source dev="/dev/sdd"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <serial>028cbbd8-dfd7-451a-9604-39c350d0edd8</serial>
Jul 27 12:40:55 user nova-compute[70994]:     </disk>
Jul 27 12:40:55 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:55 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:55 user nova-compute[70994]:       <source dev="/dev/sdf"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <serial>df9ccaa0-8458-4f71-a2d6-0378048a2b0d</serial>
Jul 27 12:40:55 user nova-compute[70994]:     </disk>
Jul 27 12:40:55 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:40:55 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:40:55 user nova-compute[70994]:       <source dev="/dev/sdg"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="vdc" bus="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <serial>4c55f37e-1dd1-4970-99b3-8f4d73a62f88</serial>
Jul 27 12:40:55 user nova-compute[70994]:     </disk>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:da:b7:c6"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tapf8924976-f9"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:b4:45:9c"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tap9ee9b8be-fb"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:6f:71:2e"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tapd657fe94-5d"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:39:1d:0c"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tap3b3e3584-99"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:c4:e5:d6"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tap92b87fcb-1b"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:27:9f:1c"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tapef56aaf1-08"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:40:55 user nova-compute[70994]:       <mac address="fa:16:3e:47:49:20"/>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:40:55 user nova-compute[70994]:       <target dev="tapbc495d56-5c"/>
Jul 27 12:40:55 user nova-compute[70994]:     </interface>
Jul 27 12:40:55 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:40:55 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/console.log" append="off"/>
Jul 27 12:40:55 user nova-compute[70994]:     </serial>
Jul 27 12:40:55 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:40:55 user nova-compute[70994]:     <video>
Jul 27 12:40:55 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:40:55 user nova-compute[70994]:     </video>
Jul 27 12:40:55 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:40:55 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:40:55 user nova-compute[70994]:     </rng>
Jul 27 12:40:55 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:40:55 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:40:55 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:40:55 user nova-compute[70994]:     </memballoon>
Jul 27 12:40:55 user nova-compute[70994]:   </devices>
Jul 27 12:40:55 user nova-compute[70994]: </domain>
Jul 27 12:40:55 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8924976-f9, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8924976-f9, col_values=(('external_ids', {'iface-id': 'f8924976-f987-42b4-a080-b635ce4fefc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b7:c6', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9')
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ee9b8be-fb, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ee9b8be-fb, col_values=(('external_ids', {'iface-id': '9ee9b8be-fb27-4677-924e-038b96735a35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:45:9c', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb')
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd657fe94-5d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd657fe94-5d, col_values=(('external_ids', {'iface-id': 'd657fe94-5dfc-4f2b-b23a-f13056d986c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:71:2e', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:55 user nova-compute[70994]: WARNING nova.compute.manager [req-7cd8ff1e-2981-494a-ac9b-969827b3ee17 req-3a4fb85f-1080-428c-8bed-0eea5765e25b service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 for instance with vm_state building and task_state spawning.
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d')
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b3e3584-99, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b3e3584-99, col_values=(('external_ids', {'iface-id': '3b3e3584-994e-440b-81b3-1d6a5fc98923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:1d:0c', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99')
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92b87fcb-1b, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92b87fcb-1b, col_values=(('external_ids', {'iface-id': '92b87fcb-1b9b-45d7-bcd9-b71f78b22b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:e5:d6', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b')
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef56aaf1-08, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef56aaf1-08, col_values=(('external_ids', {'iface-id': 'ef56aaf1-08ae-49d6-b8a3-296ebc3ca309', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9f:1c', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08')
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc495d56-5c, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc495d56-5c, col_values=(('external_ids', {'iface-id': 'bc495d56-5cc3-4e23-b0c8-7a18b582df31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:49:20', 'vm-uuid': 'c7fb777c-fae8-438d-a339-478ed2f8cb49'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:56 user nova-compute[70994]: WARNING nova.compute.manager [req-aced9ce8-5b92-40f8-b86e-30c981f51d0a req-b4acac2c-89f1-4655-a83c-25f74dceba56 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 for instance with vm_state building and task_state spawning.
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: INFO os_vif [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c')
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] No BDM found with device name hda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] No VIF found with MAC fa:16:3e:da:b7:c6, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] No VIF found with MAC fa:16:3e:c4:e5:d6, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:40:56 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Using config drive
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Creating config drive at /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/disk.config
Jul 27 12:40:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnfnwsgrw {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnfnwsgrw" returned: 0 in 0.065s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-8dd38821-da77-4b5e-8a04-b1e4b902543f req-7720c196-b4e5-4697-889c-1484a35e0ffe service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 for instance with vm_state building and task_state spawning.
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:57 user nova-compute[70994]: WARNING nova.compute.manager [req-901c5a01-97fc-4f21-9f46-92b7cad1eeb9 req-5bd82f3b-8e0e-4854-8978-3e46c7702e10 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 for instance with vm_state building and task_state spawning.
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:58 user nova-compute[70994]: WARNING nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 for instance with vm_state building and task_state spawning.
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:58 user nova-compute[70994]: WARNING nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 for instance with vm_state building and task_state spawning.
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:58 user nova-compute[70994]: WARNING nova.compute.manager [req-a391c63c-6a22-491b-82a0-90f4f99846be req-c6683342-2324-456e-bbeb-498664e23f3a service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 for instance with vm_state building and task_state spawning.
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:40:59 user nova-compute[70994]: INFO nova.compute.claims [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Claim successful on node user
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:59 user nova-compute[70994]: WARNING nova.compute.manager [req-99c364f6-541c-49f9-9095-56ae3107c118 req-f4b5a324-1ab9-4e42-948e-5c6ab8100be9 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 for instance with vm_state building and task_state spawning.
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:59 user nova-compute[70994]: WARNING nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 for instance with vm_state building and task_state spawning.
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:40:59 user nova-compute[70994]: WARNING nova.compute.manager [req-e622ab83-6db7-45c8-a633-65c14d606e93 req-78bcc084-62c7-4820-b730-7e955cd13727 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 for instance with vm_state building and task_state spawning.
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:40:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461660.081328, b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] VM Resumed (Lifecycle Event)
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance spawned successfully.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461660.085745, b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] VM Started (Lifecycle Event)
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Took 13.29 seconds to spawn the instance on the hypervisor.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Took 37.98 seconds to build instance.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1e08f509-cca5-4c51-8974-d0cdb1cf614f tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.086s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.compute.manager [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Rescuing
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:00 user nova-compute[70994]: WARNING nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 for instance with vm_state building and task_state spawning.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:00 user nova-compute[70994]: WARNING nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 for instance with vm_state building and task_state spawning.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:00 user nova-compute[70994]: WARNING nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 for instance with vm_state building and task_state spawning.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:00 user nova-compute[70994]: WARNING nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 for instance with vm_state building and task_state spawning.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:00 user nova-compute[70994]: WARNING nova.compute.manager [req-7c9aa956-6396-4d04-bbfb-f6432e91f41c req-cda19f61-3ce1-4e74-9c62-81fa137a03b3 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 for instance with vm_state building and task_state spawning.
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:41:00 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Creating image(s)
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "/opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "/opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.policy [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f524fef921904389beb9e62ddd33512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c5028166444a07a4f9ccdc9206df91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.228s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk 1073741824" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:01 user nova-compute[70994]: WARNING nova.compute.manager [req-87baa63b-9077-4ebd-844e-450a787e8412 req-9c0380f7-2fb1-46c4-b0fc-7c69dfbaa813 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 for instance with vm_state building and task_state spawning.
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.425s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 for instance with vm_state building and task_state spawning.
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 for instance with vm_state building and task_state spawning.
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3c5a4801-6b12-4fe5-88fc-3a5196426ad8 req-a2895a4e-7183-4d7f-a3b6-02597b1ecf58 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 for instance with vm_state building and task_state spawning.
Jul 27 12:41:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Cannot resize image /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'migration_context' on Instance uuid 6cf552b3-722e-49fd-b915-bed44ba8ab84 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Ensure instance console log exists: /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Successfully created port: 21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:02 user nova-compute[70994]: WARNING nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 for instance with vm_state building and task_state spawning.
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:02 user nova-compute[70994]: WARNING nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state active and task_state rescuing.
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:02 user nova-compute[70994]: WARNING nova.compute.manager [req-dcd206e1-80eb-43d2-ba31-db9da1d4c8c0 req-19f27ff4-785a-4055-95da-cd9f638d2b44 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state active and task_state rescuing.
Jul 27 12:41:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance destroyed successfully.
Jul 27 12:41:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Attempting rescue
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:41:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Creating image(s)
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'trusted_certs' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue" returned: 0 in 0.063s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start _get_guest_xml network_info=[{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:24:04:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'numa_topology' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:03 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'vcpu_model' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-365758352',display_name='tempest-ServerRescueNegativeTestJSON-server-365758352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-365758352',id=3,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-p5w2b089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:28Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=e31094ff-43ca-4256-a933-25ee73995818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:24:04:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:24:04:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:41:03 user nova-compute[70994]:   <uuid>e31094ff-43ca-4256-a933-25ee73995818</uuid>
Jul 27 12:41:03 user nova-compute[70994]:   <name>instance-00000003</name>
Jul 27 12:41:03 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:41:03 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:41:03 user nova-compute[70994]:   <metadata>
Jul 27 12:41:03 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:41:03 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-365758352</nova:name>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:41:03</nova:creationTime>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:41:03 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:owner>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:owner>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:ports>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:port uuid="6c9ac57f-028b-466a-bb8f-5b74e174dcd6">
Jul 27 12:41:03 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:41:03 user nova-compute[70994]:         </nova:port>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:ports>
Jul 27 12:41:03 user nova-compute[70994]:     </nova:instance>
Jul 27 12:41:03 user nova-compute[70994]:   </metadata>
Jul 27 12:41:03 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:41:03 user nova-compute[70994]:     <system>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="serial">e31094ff-43ca-4256-a933-25ee73995818</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="uuid">e31094ff-43ca-4256-a933-25ee73995818</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:41:03 user nova-compute[70994]:     </system>
Jul 27 12:41:03 user nova-compute[70994]:   </sysinfo>
Jul 27 12:41:03 user nova-compute[70994]:   <os>
Jul 27 12:41:03 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:41:03 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:41:03 user nova-compute[70994]:   </os>
Jul 27 12:41:03 user nova-compute[70994]:   <features>
Jul 27 12:41:03 user nova-compute[70994]:     <acpi/>
Jul 27 12:41:03 user nova-compute[70994]:     <apic/>
Jul 27 12:41:03 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:41:03 user nova-compute[70994]:   </features>
Jul 27 12:41:03 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:41:03 user nova-compute[70994]:   </clock>
Jul 27 12:41:03 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:41:03 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:41:03 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:41:03 user nova-compute[70994]:   </cpu>
Jul 27 12:41:03 user nova-compute[70994]:   <devices>
Jul 27 12:41:03 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:41:03 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:41:03 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue"/>
Jul 27 12:41:03 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:     </disk>
Jul 27 12:41:03 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:41:03 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:41:03 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk"/>
Jul 27 12:41:03 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:     </disk>
Jul 27 12:41:03 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:41:03 user nova-compute[70994]:       <mac address="fa:16:3e:24:04:48"/>
Jul 27 12:41:03 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:41:03 user nova-compute[70994]:       <target dev="tap6c9ac57f-02"/>
Jul 27 12:41:03 user nova-compute[70994]:     </interface>
Jul 27 12:41:03 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:41:03 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/console.log" append="off"/>
Jul 27 12:41:03 user nova-compute[70994]:     </serial>
Jul 27 12:41:03 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:41:03 user nova-compute[70994]:     <video>
Jul 27 12:41:03 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:     </video>
Jul 27 12:41:03 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:41:03 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:41:03 user nova-compute[70994]:     </rng>
Jul 27 12:41:03 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:41:03 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:41:03 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:41:03 user nova-compute[70994]:     </memballoon>
Jul 27 12:41:03 user nova-compute[70994]:   </devices>
Jul 27 12:41:03 user nova-compute[70994]: </domain>
Jul 27 12:41:03 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance destroyed successfully.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:24:04:48, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461663.293489, c7fb777c-fae8-438d-a339-478ed2f8cb49 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] VM Resumed (Lifecycle Event)
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance spawned successfully.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461663.295537, c7fb777c-fae8-438d-a339-478ed2f8cb49 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] VM Started (Lifecycle Event)
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Successfully updated port: 21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Took 14.72 seconds to spawn the instance on the hypervisor.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquired lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:41:03 user nova-compute[70994]: INFO nova.compute.manager [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Took 37.46 seconds to build instance.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-af6de91c-39a7-4a46-bbdb-607251dd6a0b tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.570s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Updating instance_info_cache with network_info: [{"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Releasing lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Instance network_info: |[{"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Start _get_guest_xml network_info=[{"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:41:03 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:03 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1313136011',display_name='tempest-ServersNegativeTestJSON-server-1313136011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1313136011',id=14,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-yxsbxrk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:41:01Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=6cf552b3-722e-49fd-b915-bed44ba8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cf552b3-722e-49fd-b915-bed44ba8ab84 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:41:03 user nova-compute[70994]:   <uuid>6cf552b3-722e-49fd-b915-bed44ba8ab84</uuid>
Jul 27 12:41:03 user nova-compute[70994]:   <name>instance-0000000e</name>
Jul 27 12:41:03 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:41:03 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:41:03 user nova-compute[70994]:   <metadata>
Jul 27 12:41:03 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:41:03 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:name>tempest-ServersNegativeTestJSON-server-1313136011</nova:name>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:41:03</nova:creationTime>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:41:03 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:owner>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:user uuid="f524fef921904389beb9e62ddd33512e">tempest-ServersNegativeTestJSON-334834209-project-member</nova:user>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:project uuid="11c5028166444a07a4f9ccdc9206df91">tempest-ServersNegativeTestJSON-334834209</nova:project>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:owner>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:41:03 user nova-compute[70994]:       <nova:ports>
Jul 27 12:41:03 user nova-compute[70994]:         <nova:port uuid="21290824-2cf3-45a7-a124-2a4bb4240652">
Jul 27 12:41:03 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 12:41:03 user nova-compute[70994]:         </nova:port>
Jul 27 12:41:03 user nova-compute[70994]:       </nova:ports>
Jul 27 12:41:03 user nova-compute[70994]:     </nova:instance>
Jul 27 12:41:03 user nova-compute[70994]:   </metadata>
Jul 27 12:41:03 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:41:03 user nova-compute[70994]:     <system>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="serial">6cf552b3-722e-49fd-b915-bed44ba8ab84</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="uuid">6cf552b3-722e-49fd-b915-bed44ba8ab84</entry>
Jul 27 12:41:03 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:41:03 user nova-compute[70994]:     </system>
Jul 27 12:41:03 user nova-compute[70994]:   </sysinfo>
Jul 27 12:41:03 user nova-compute[70994]:   <os>
Jul 27 12:41:03 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:41:03 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:41:03 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:41:03 user nova-compute[70994]:   </os>
Jul 27 12:41:03 user nova-compute[70994]:   <features>
Jul 27 12:41:03 user nova-compute[70994]:     <acpi/>
Jul 27 12:41:03 user nova-compute[70994]:     <apic/>
Jul 27 12:41:03 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:41:03 user nova-compute[70994]:   </features>
Jul 27 12:41:03 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:41:03 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:41:03 user nova-compute[70994]:   </clock>
Jul 27 12:41:03 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:41:03 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:41:03 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:41:03 user nova-compute[70994]:   </cpu>
Jul 27 12:41:03 user nova-compute[70994]:   <devices>
Jul 27 12:41:03 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:41:03 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:41:03 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk"/>
Jul 27 12:41:03 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:     </disk>
Jul 27 12:41:03 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:41:03 user nova-compute[70994]:       <mac address="fa:16:3e:de:9f:58"/>
Jul 27 12:41:03 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:41:03 user nova-compute[70994]:       <target dev="tap21290824-2c"/>
Jul 27 12:41:03 user nova-compute[70994]:     </interface>
Jul 27 12:41:03 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:41:03 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/console.log" append="off"/>
Jul 27 12:41:03 user nova-compute[70994]:     </serial>
Jul 27 12:41:03 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:41:03 user nova-compute[70994]:     <video>
Jul 27 12:41:03 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:03 user nova-compute[70994]:     </video>
Jul 27 12:41:03 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:41:03 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:41:03 user nova-compute[70994]:     </rng>
Jul 27 12:41:03 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:41:03 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:41:03 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:41:03 user nova-compute[70994]:     </memballoon>
Jul 27 12:41:03 user nova-compute[70994]:   </devices>
Jul 27 12:41:03 user nova-compute[70994]: </domain>
Jul 27 12:41:03 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1313136011',display_name='tempest-ServersNegativeTestJSON-server-1313136011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1313136011',id=14,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-yxsbxrk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:41:01Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=6cf552b3-722e-49fd-b915-bed44ba8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG os_vif [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21290824-2c, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21290824-2c, col_values=(('external_ids', {'iface-id': '21290824-2cf3-45a7-a124-2a4bb4240652', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:9f:58', 'vm-uuid': '6cf552b3-722e-49fd-b915-bed44ba8ab84'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:41:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:03 user nova-compute[70994]: INFO os_vif [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c')
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:04 user nova-compute[70994]: WARNING nova.compute.manager [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 for instance with vm_state active and task_state None.
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-changed-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Refreshing instance network info cache due to event network-changed-21290824-2cf3-45a7-a124-2a4bb4240652. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Acquiring lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Acquired lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Refreshing network info cache for port 21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] No VIF found with MAC fa:16:3e:de:9f:58, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Updated VIF entry in instance network info cache for port 21290824-2cf3-45a7-a124-2a4bb4240652. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Updating instance_info_cache with network_info: [{"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-64a11980-3d13-4372-aaa1-a3b8db48b024 req-648aa390-50a7-4d01-8024-32d09cf3e29b service nova] Releasing lock "refresh_cache-6cf552b3-722e-49fd-b915-bed44ba8ab84" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG nova.compute.manager [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:04 user nova-compute[70994]: INFO nova.compute.manager [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] instance snapshotting
Jul 27 12:41:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Beginning live snapshot process
Jul 27 12:41:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:05 user nova-compute[70994]: WARNING nova.compute.manager [req-cc3de197-e10a-4ac4-8dd1-67282bb96d93 req-4d00c305-f7f7-4037-9916-1d65f4a33785 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state active and task_state rescuing.
Jul 27 12:41:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793.delta 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793.delta 1073741824" returned: 0 in 0.052s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 12:41:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70994) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 27 12:41:05 user nova-compute[70994]: INFO nova.virt.libvirt.host [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] UEFI support detected
Jul 27 12:41:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] No waiting events found dispatching network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:06 user nova-compute[70994]: WARNING nova.compute.manager [req-d89b3871-4055-45dd-a932-2bb06d1f445e req-890e6959-08f3-4490-bdae-cb3951bf9394 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received unexpected event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 for instance with vm_state building and task_state spawning.
Jul 27 12:41:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lazy-loading 'flavor' on Instance uuid 953c1df6-c793-4181-a52b-8c5da4256afd {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:07 user nova-compute[70994]: WARNING nova.compute.manager [req-52c5b28c-5995-4bcf-81f9-9085f123b2a0 req-1c7fec24-6a30-424b-b351-2ed9f3d21c3c service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state active and task_state rescuing.
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.163s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] COPY block job progress, current cursor: 75497471 final cursor: 75497472 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:07 user nova-compute[70994]: INFO nova.compute.manager [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Attaching volume 936e3f20-fd61-4499-bdfb-a40c756f1a4c to /dev/vdb
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.utils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[67683522-840b-42c0-b4d0-f3a38a6ba239]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35487081-9f58-49fc-92b1-f1110eaeb80d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d09a19-9ee2-4553-9f99-f17836ef60bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6627d016-fde3-4b7b-8ce3-7aa5ce012da2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:07 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb3e222-d4e4-4ea6-8649-7436c3cf8c9d]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG os_brick.utils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:07 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Updating existing volume attachment record: 45a512be-8a3d-46e9-a7c0-bbd0e4fcf00f {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 12:41:08 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793.delta /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] No waiting events found dispatching network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:08 user nova-compute[70994]: WARNING nova.compute.manager [req-3c828079-4f56-4a1f-add0-ead835b8400f req-b72222c2-2e60-4082-a28c-247131694116 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received unexpected event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 for instance with vm_state building and task_state spawning.
Jul 27 12:41:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793.delta /opt/stack/data/nova/instances/snapshots/tmpj67caygz/e38cb58fd90041668e587c07fcc3a793" returned: 0 in 0.807s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:09 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Snapshot extracted, beginning image upload
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing instance network info cache due to event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.network.neutron [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for e31094ff-43ca-4256-a933-25ee73995818 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461669.885679, e31094ff-43ca-4256-a933-25ee73995818 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:09 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] VM Resumed (Lifecycle Event)
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4087bcdd-0e3d-49dd-ad91-e269dda790c0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:09 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:41:09 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461669.8888965, e31094ff-43ca-4256-a933-25ee73995818 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:09 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] VM Started (Lifecycle Event)
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Instance spawned successfully.
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461670.1122973, 6cf552b3-722e-49fd-b915-bed44ba8ab84 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] VM Resumed (Lifecycle Event)
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461670.112398, 6cf552b3-722e-49fd-b915-bed44ba8ab84 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] VM Started (Lifecycle Event)
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Took 9.38 seconds to spawn the instance on the hypervisor.
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:10 user nova-compute[70994]: INFO nova.compute.manager [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Took 10.65 seconds to build instance.
Jul 27 12:41:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9a83f910-ea42-4e6b-a879-3387277b2af9 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.811s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updated VIF entry in instance network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-20f9d9f1-8f7f-4167-b81f-d2c8a1c03441 req-31a91b21-f1f5-43d6-a3b3-476956478b6f service nova] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-changed-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Refreshing instance network info cache due to event network-changed-5342fa4a-a64a-4af0-a4ba-8cf183415666. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] Acquiring lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] Acquired lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Refreshing network info cache for port 5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:13 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Snapshot image upload complete
Jul 27 12:41:13 user nova-compute[70994]: INFO nova.compute.manager [None req-8d4eb9a8-3bd0-4c30-ac35-be3e5aa90eef tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Took 8.21 seconds to snapshot the instance on the hypervisor.
Jul 27 12:41:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updated VIF entry in instance network info cache for port 5342fa4a-a64a-4af0-a4ba-8cf183415666. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updating instance_info_cache with network_info: [{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-736d605e-4944-4b39-856b-b4967d651781 req-3d9f687b-6588-4182-8dee-178bf97d5e7e service nova] Releasing lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing instance network info cache due to event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:14 user nova-compute[70994]: DEBUG nova.network.neutron [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updated VIF entry in instance network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:14 user nova-compute[70994]: DEBUG nova.network.neutron [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-096e3ddb-545c-4132-acd3-6ff404f33187 req-69b78001-01e9-4123-beaf-bdf7c4ebc647 service nova] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:14 user nova-compute[70994]: INFO nova.compute.manager [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Shelving
Jul 27 12:41:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:15 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance destroyed successfully.
Jul 27 12:41:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:15 user nova-compute[70994]: WARNING nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state active and task_state shelving.
Jul 27 12:41:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:15 user nova-compute[70994]: WARNING nova.compute.manager [req-5e4df688-1366-41c4-8025-2f01a922d4b9 req-93abfde0-010e-4e80-8686-986d27f1c272 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state active and task_state shelving.
Jul 27 12:41:15 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Beginning cold snapshot process
Jul 27 12:41:16 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk /opt/stack/data/nova/instances/snapshots/tmp31i64qa_/b176d6b995974b25b8b1e89ed4afe17e {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk /opt/stack/data/nova/instances/snapshots/tmp31i64qa_/b176d6b995974b25b8b1e89ed4afe17e" returned: 0 in 0.636s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Snapshot extracted, beginning image upload
Jul 27 12:41:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxLhjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:16 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:16 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:16 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3f397-4a7d-492d-9af1-cc455b4eb62c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:16 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf6588-6b46-45e1-96a1-4949bad21eac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c] added
Jul 27 12:41:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dadb107-b506-44aa-afce-e0c4cb643c2e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2423e079-9f66-4075-9e36-2123b778953a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaxLhjiK {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaxLhjiK" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f950ee-3c20-4fab-8c83-1bf86affc082]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaxLhjiK'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69207e05-ffc3-429e-8e62-e6da20176d58]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c96b55-dbb6-4667-84a7-e4e7fa5ac08e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3055cc-0def-4094-a670-585ab4ff636f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260]
Jul 27 12:41:17 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:17 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f1436-4d94-4707-aa69-577ecd889df7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba2a366-a6cf-4fb9-bce7-5d58430c3ee5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)
Jul 27 12:41:17 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:17 user nova-compute[70994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)
Jul 27 12:41:17 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c8f4a-7e98-4a1e-9c00-aafc548aa686]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxLhjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23463323130633333', 'path': '/dev/sdh'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463323130633333', 'path': '/dev/sdh'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lazy-loading 'flavor' on Instance uuid 953c1df6-c793-4181-a52b-8c5da4256afd {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:41:18 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:18 user nova-compute[70994]:   <source dev="/dev/sdh"/>
Jul 27 12:41:18 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:41:18 user nova-compute[70994]:   <serial>936e3f20-fd61-4499-bdfb-a40c756f1a4c</serial>
Jul 27 12:41:18 user nova-compute[70994]: </disk>
Jul 27 12:41:18 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:41:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] No VIF found with MAC fa:16:3e:d6:0b:6a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-371400c2-5035-4860-889e-eaf20a0740d7 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.648s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Snapshot image upload complete
Jul 27 12:41:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:20 user nova-compute[70994]: INFO nova.compute.manager [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Shelve offloading
Jul 27 12:41:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance destroyed successfully.
Jul 27 12:41:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:20 user nova-compute[70994]: INFO nova.compute.manager [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Terminating instance
Jul 27 12:41:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-unplugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] No waiting events found dispatching network-vif-unplugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-aebb929d-b704-40c7-91c5-52b29284b9f8 req-2d072ed1-f7f7-4b46-951a-3c176d76962b service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-unplugged-63433765-2221-40a7-b5b0-ac7195558a10 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Instance destroyed successfully.
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lazy-loading 'resources' on Instance uuid 953c1df6-c793-4181-a52b-8c5da4256afd {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-479237388',display_name='tempest-DeleteServersTestJSON-server-479237388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-479237388',id=4,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8fb873d37f845b7b9f52b9833e5a991',ramdisk_id='',reservation_id='r-8iil0v0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-742861528',owner_user_name='tempest-DeleteServersTestJSON-742861528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:37Z,user_data=None,user_id='17860e9315e646d2a387f9925c9b8ccb',uuid=953c1df6-c793-4181-a52b-8c5da4256afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converting VIF {"id": "63433765-2221-40a7-b5b0-ac7195558a10", "address": "fa:16:3e:d6:0b:6a", "network": {"id": "0fa64262-9023-416e-8555-e86d2aefdc51", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1047011975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fb873d37f845b7b9f52b9833e5a991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63433765-22", "ovs_interfaceid": "63433765-2221-40a7-b5b0-ac7195558a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_vif [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63433765-22, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: INFO os_vif [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:0b:6a,bridge_name='br-int',has_traffic_filtering=True,id=63433765-2221-40a7-b5b0-ac7195558a10,network=Network(0fa64262-9023-416e-8555-e86d2aefdc51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63433765-22')
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxLhjiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:21 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74401c98-6814-424d-bc72-3edf3075d23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:41:21 user nova-compute[70994]: No targets found.
Jul 27 12:41:21 user nova-compute[70994]: iSNS:
Jul 27 12:41:21 user nova-compute[70994]: No targets found.
Jul 27 12:41:21 user nova-compute[70994]: STATIC:
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:41:21 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:21 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:21 user nova-compute[70994]: FIRMWARE:
Jul 27 12:41:21 user nova-compute[70994]: No targets found.
Jul 27 12:41:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:41:21 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:41:21 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[80298bfa-9dbf-4bfc-8574-6e8a3e68d945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89de074-149e-4ccf-8ac8-b575c658a975]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)
Jul 27 12:41:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:21 user nova-compute[70994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c (non-flash)
Jul 27 12:41:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88fc073e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c'): ({'sdh'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Removing single pathed devices sdh {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ddab0c-ffdd-412f-8952-73dd677b3d66]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c13ca2-95e7-4f00-906a-d9e8b5834f55]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Flushing IO for device /dev/sdh {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6bd1ef-848b-4afc-9072-30a87bf5dfab]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b845f75-670f-4eff-bf71-f85e6464de7a]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance destroyed successfully.
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'resources' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHA/0ZdIUUbuXgXuYWyt8Ne9/98bA7k/UnTKqmwDW5XVpm4ojrYuM0B8LSBiW3zj3V03WTiJfa4aimiP/566c7Yds/L0cTgvtmWuKEOEfouSNK3EYYKsckqZy9YEHPmDQ==',key_name='tempest-keypair-1555823318',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:41:20.086766',shelved_host='user',shelved_image_id='0207b707-fe48-4158-bca9-b172e0a394a3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_vif [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f23a04a-22, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d558608-b042-4b6c-a4f6-2508892aa180]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: INFO os_vif [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22')
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Deleting instance files /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50_del
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Deletion of /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50_del complete
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing instance network info cache due to event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.neutron [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b8f508-a4d6-4953-acd8-29f0da480109]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260]
Jul 27 12:41:21 user nova-compute[70994]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:936e3f20-fd61-4499-bdfb-a40c756f1a4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[609878a9-755e-486a-9327-18bfbc31c77f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] <== disconnect_volume: return (459ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Deleting instance files /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd_del
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Deletion of /opt/stack/data/nova/instances/953c1df6-c793-4181-a52b-8c5da4256afd_del complete
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Deleted allocations for instance 4a853286-11ba-4a34-824b-bc59b8a5ac50
Jul 27 12:41:21 user nova-compute[70994]: INFO nova.compute.manager [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Took 1.45 seconds to destroy the instance on the hypervisor.
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updated VIF entry in instance network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3f23a04a-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d8372b2b-ed0b-4655-a197-49179e22e121 req-def63767-adac-42ea-843f-f7036acfb956 service nova] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e980920f-3927-40de-8ca1-21a1ca5d1c19 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.774s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:41:22 user nova-compute[70994]: INFO nova.compute.claims [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Claim successful on node user
Jul 27 12:41:22 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Took 0.89 seconds to deallocate network for instance.
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] Acquiring lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] Lock "953c1df6-c793-4181-a52b-8c5da4256afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] No waiting events found dispatching network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:23 user nova-compute[70994]: WARNING nova.compute.manager [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received unexpected event network-vif-plugged-63433765-2221-40a7-b5b0-ac7195558a10 for instance with vm_state active and task_state deleting.
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-c5044388-bbf3-4e65-8b11-9e49a40bec56 req-e69626e9-92d0-4212-a866-e1be3ff80945 service nova] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Received event network-vif-deleted-63433765-2221-40a7-b5b0-ac7195558a10 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:41:23 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.policy [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549272be22b842818d896dd8e4f79132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bb670b38a14ac6a4583f39b7cfedb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:41:23 user nova-compute[70994]: INFO nova.virt.block_device [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Booting with volume f32b4fcf-7494-414d-ba47-46f6a1e03f29 at /dev/vda
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.utils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6372319-86c0-43f8-a5d8-39a8650d9ae0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d014a2-60cb-406a-9516-d600a9027400]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec57ef-8309-4d48-a71a-6b3216857e5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f11105-59ec-4968-84b4-7247c913f198]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:23 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20258a6b-deee-41ca-8409-2d310c91f5e7]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG os_brick.utils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating existing volume attachment record: 3a7ed481-1bf6-4020-b854-0afd209c47d0 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:41:23 user nova-compute[70994]: INFO nova.compute.manager [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Took 1.06 seconds to detach 1 volumes for instance.
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:24 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Successfully created port: 4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:41:24 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:41:24 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:41:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:24 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Deleted allocations for instance 953c1df6-c793-4181-a52b-8c5da4256afd
Jul 27 12:41:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1b0ee79f-ea6d-48fc-a443-3ca7d01e0487 tempest-DeleteServersTestJSON-742861528 tempest-DeleteServersTestJSON-742861528-project-member] Lock "953c1df6-c793-4181-a52b-8c5da4256afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.122s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Successfully updated port: 4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquired lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-changed-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Refreshing instance network info cache due to event network-changed-4f2b0d75-4dee-4bee-8d18-871bf5922540. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] Acquiring lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating instance_info_cache with network_info: [{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Releasing lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance network_info: |[{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] Acquired lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Refreshing network info cache for port 4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updating instance_info_cache with network_info: [{"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-b33c60f9-d979-419e-aa9a-9f0844c35e62" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updated VIF entry in instance network info cache for port 4f2b0d75-4dee-4bee-8d18-871bf5922540. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating instance_info_cache with network_info: [{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9d6876d-66d3-4c8a-9bf3-72dd2e73c0c2 req-b79a20c3-ed0a-4024-8d8b-a7d447331f09 service nova] Releasing lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461675.835798, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:30 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Stopped (Lifecycle Event)
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1af74a65-f5e9-4f66-b292-23e8ed7b1385 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:41:31 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Creating image(s)
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Ensure instance console log exists: /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start _get_guest_xml network_info=[{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cb0bf10-69e2-4494-9b67-d53d48e83446', 'attached_at': '', 'detached_at': '', 'volume_id': 'f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'serial': 'f32b4fcf-7494-414d-ba47-46f6a1e03f29'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '3a7ed481-1bf6-4020-b854-0afd209c47d0', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:41:31 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:31 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:31 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:31 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:31 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[904318d8-75ac-4ef9-83b6-9fa730a6150d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:31 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59446d6-4f1d-47c4-9260-77173336478f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29] added
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a21e99-5031-438b-bbce-7b3ff15a715b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a9401c-b660-4037-a7f9-33a1c7571293]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMgHjKTt {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMgHjKTt" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e200358-a12b-464c-90ab-41f397cfb67a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMgHjKTt'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61f10a-30bb-4601-aa53-1797c47ecef6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7e0a2-9702-4ed9-9011-03f39e7b7bde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f601e1b3-f000-40f2-a682-1cc1cb01b7d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]
Jul 27 12:41:31 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49872b-2efc-4723-ab7c-a175b8b13212]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eba648d-d656-4819-8678-4c8ab8b03f6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4442701b-e483-4e2e-ba35-ba3fa027d915]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=6436MB free_disk=25.649795532226562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 662c50c8-4f10-4cc1-b537-cf31dde13cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance d18149ad-4761-4986-9ccf-199b3ef176ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance c7fb777c-fae8-438d-a339-478ed2f8cb49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 6cf552b3-722e-49fd-b915-bed44ba8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2cb0bf10-69e2-4494-9b67-d53d48e83446 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26662666132666165', 'path': '/dev/sdh'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662666132666165', 'path': '/dev/sdh'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1356447569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:41:32 user nova-compute[70994]:   <uuid>2cb0bf10-69e2-4494-9b67-d53d48e83446</uuid>
Jul 27 12:41:32 user nova-compute[70994]:   <name>instance-0000000f</name>
Jul 27 12:41:32 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:41:32 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:41:32 user nova-compute[70994]:   <metadata>
Jul 27 12:41:32 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:41:32 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:41:32 user nova-compute[70994]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1356447569</nova:name>
Jul 27 12:41:32 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:41:31</nova:creationTime>
Jul 27 12:41:32 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:41:32 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:41:32 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:41:32 user nova-compute[70994]:       <nova:owner>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:user uuid="549272be22b842818d896dd8e4f79132">tempest-ServerActionsV293TestJSON-771279538-project-member</nova:user>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:project uuid="21bb670b38a14ac6a4583f39b7cfedb7">tempest-ServerActionsV293TestJSON-771279538</nova:project>
Jul 27 12:41:32 user nova-compute[70994]:       </nova:owner>
Jul 27 12:41:32 user nova-compute[70994]:       <nova:ports>
Jul 27 12:41:32 user nova-compute[70994]:         <nova:port uuid="4f2b0d75-4dee-4bee-8d18-871bf5922540">
Jul 27 12:41:32 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:41:32 user nova-compute[70994]:         </nova:port>
Jul 27 12:41:32 user nova-compute[70994]:       </nova:ports>
Jul 27 12:41:32 user nova-compute[70994]:     </nova:instance>
Jul 27 12:41:32 user nova-compute[70994]:   </metadata>
Jul 27 12:41:32 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:41:32 user nova-compute[70994]:     <system>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="serial">2cb0bf10-69e2-4494-9b67-d53d48e83446</entry>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="uuid">2cb0bf10-69e2-4494-9b67-d53d48e83446</entry>
Jul 27 12:41:32 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:41:32 user nova-compute[70994]:     </system>
Jul 27 12:41:32 user nova-compute[70994]:   </sysinfo>
Jul 27 12:41:32 user nova-compute[70994]:   <os>
Jul 27 12:41:32 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:41:32 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:41:32 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:41:32 user nova-compute[70994]:   </os>
Jul 27 12:41:32 user nova-compute[70994]:   <features>
Jul 27 12:41:32 user nova-compute[70994]:     <acpi/>
Jul 27 12:41:32 user nova-compute[70994]:     <apic/>
Jul 27 12:41:32 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:41:32 user nova-compute[70994]:   </features>
Jul 27 12:41:32 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:41:32 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:41:32 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:41:32 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:41:32 user nova-compute[70994]:   </clock>
Jul 27 12:41:32 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:41:32 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:41:32 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:41:32 user nova-compute[70994]:   </cpu>
Jul 27 12:41:32 user nova-compute[70994]:   <devices>
Jul 27 12:41:32 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:41:32 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:32 user nova-compute[70994]:       <source dev="/dev/sdh"/>
Jul 27 12:41:32 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:41:32 user nova-compute[70994]:       <serial>f32b4fcf-7494-414d-ba47-46f6a1e03f29</serial>
Jul 27 12:41:32 user nova-compute[70994]:     </disk>
Jul 27 12:41:32 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:41:32 user nova-compute[70994]:       <mac address="fa:16:3e:54:9d:96"/>
Jul 27 12:41:32 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:32 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:41:32 user nova-compute[70994]:       <target dev="tap4f2b0d75-4d"/>
Jul 27 12:41:32 user nova-compute[70994]:     </interface>
Jul 27 12:41:32 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:41:32 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446/console.log" append="off"/>
Jul 27 12:41:32 user nova-compute[70994]:     </serial>
Jul 27 12:41:32 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:41:32 user nova-compute[70994]:     <video>
Jul 27 12:41:32 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:41:32 user nova-compute[70994]:     </video>
Jul 27 12:41:32 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:41:32 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:41:32 user nova-compute[70994]:     </rng>
Jul 27 12:41:32 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:41:32 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:41:32 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:41:32 user nova-compute[70994]:     </memballoon>
Jul 27 12:41:32 user nova-compute[70994]:   </devices>
Jul 27 12:41:32 user nova-compute[70994]: </domain>
Jul 27 12:41:32 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1356447569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG os_vif [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f2b0d75-4d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f2b0d75-4d, col_values=(('external_ids', {'iface-id': '4f2b0d75-4dee-4bee-8d18-871bf5922540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:9d:96', 'vm-uuid': '2cb0bf10-69e2-4494-9b67-d53d48e83446'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:32 user nova-compute[70994]: INFO os_vif [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d')
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No VIF found with MAC fa:16:3e:54:9d:96, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:41:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:34 user nova-compute[70994]: WARNING nova.compute.manager [req-528d4aa4-8b08-4b06-8a55-35a2a69452a8 req-8c3fcc12-10dd-4666-b90f-cb7cc6439532 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state building and task_state spawning.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461681.3380609, 953c1df6-c793-4181-a52b-8c5da4256afd => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] VM Stopped (Lifecycle Event)
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:36 user nova-compute[70994]: WARNING nova.compute.manager [req-c11b83c3-defe-460f-bc29-962cc6574cb1 req-beff1063-b9c8-466c-8290-35c62c21d23a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state building and task_state spawning.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0d944a90-3687-475c-8592-49e7d0e9ca70 None None] [instance: 953c1df6-c793-4181-a52b-8c5da4256afd] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'flavor' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461696.7014048, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Resumed (Lifecycle Event)
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance spawned successfully.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461696.7046883, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Started (Lifecycle Event)
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Took 5.62 seconds to spawn the instance on the hypervisor.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attaching volume 36658d04-fdcc-4983-ba20-f55634bbe3b5 to /dev/vdb
Jul 27 12:41:36 user nova-compute[70994]: INFO nova.compute.manager [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Took 14.18 seconds to build instance.
Jul 27 12:41:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4c130bfb-b544-4168-9d67-cdf6069d7331 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.344s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:36 user nova-compute[70994]: DEBUG os_brick.utils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[290aac89-992e-498d-84d5-58727cb16ccf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8bcc08-c16a-4024-85ac-adbfa9fbeb9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b33bd5-454c-4ee3-b27b-fa2ef86c02b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fb7a0-9d6b-4434-9176-8adedcbc87ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:37 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ed7c8-346a-4e19-a708-53d103119771]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG os_brick.utils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating existing volume attachment record: 2582ce43-27af-4077-beab-552d7a8be11c {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:41:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-changed-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:38 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Refreshing instance network info cache due to event network-changed-21ff2b01-1000-4d58-b089-15568956e6ab. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Acquiring lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Acquired lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Refreshing network info cache for port 21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updated VIF entry in instance network info cache for port 21ff2b01-1000-4d58-b089-15568956e6ab. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating instance_info_cache with network_info: [{"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Releasing lock "refresh_cache-662c50c8-4f10-4cc1-b537-cf31dde13cca" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-changed-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Refreshing instance network info cache due to event network-changed-294180fe-682a-4cae-89ad-834369b928a5. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Acquiring lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Acquired lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Refreshing network info cache for port 294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-changed-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Refreshing instance network info cache due to event network-changed-5a0a980b-1231-42d9-9799-984ef056eb33. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] Acquiring lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] Acquired lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Refreshing network info cache for port 5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updated VIF entry in instance network info cache for port 294180fe-682a-4cae-89ad-834369b928a5. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updating instance_info_cache with network_info: [{"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e0ce95d-8796-45ef-b62f-87984598186e req-45981b05-3ee4-4311-9054-46e8a0ebae7a service nova] Releasing lock "refresh_cache-5d2440a0-860c-4700-9fed-224851bec304" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG nova.network.neutron [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updated VIF entry in instance network info cache for port 5a0a980b-1231-42d9-9799-984ef056eb33. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG nova.network.neutron [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating instance_info_cache with network_info: [{"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3833497c-9219-45c2-96ad-bf5182768759 req-61eb08cf-19f3-4792-8787-248a68585d9c service nova] Releasing lock "refresh_cache-d18149ad-4761-4986-9ccf-199b3ef176ae" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'flavor' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:40 user nova-compute[70994]: INFO nova.compute.manager [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Attaching volume 074d16cf-c568-4467-9bbf-4079f0385579 to /dev/vdb
Jul 27 12:41:40 user nova-compute[70994]: DEBUG os_brick.utils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1238e88-71ce-4c89-8e54-28ed87ab5b9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fdd3e9-7ab9-49c0-a3d0-400e27354a76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635e067-ba81-488d-96f5-e647749d834a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a42ed12-3840-4bfe-bacf-1d065f499484]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:41 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:41 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b5457-2988-40b7-ab9d-b988504a6252]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG os_brick.utils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:41 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updating existing volume attachment record: b8eb67b0-aa60-472d-bd85-6d5215e9cb7c {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:41:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG nova.objects.instance [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'flavor' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:43 user nova-compute[70994]: INFO nova.compute.manager [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Attaching volume de794d77-90a0-4de9-a815-3a49b88d1530 to /dev/sdc
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.utils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1487244-ee0e-4fe3-8387-6c288edd1b28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba8d007-57b0-4482-a78c-3788c5b375f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7178db1c-aaa8-4c7d-a7c5-a4a37fe19cd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[662737d4-ac31-4048-947f-52700f7e84d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:43 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92211ab1-c3fc-4a8a-bd14-b1c1090732b8]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG os_brick.utils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:43 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating existing volume attachment record: f3d97428-d5e3-4267-9f8d-90ba240f7c00 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:45 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:45 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:45 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8dd9cf-58b1-4077-af7a-985d9d749bab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:45 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[982deda5-1871-4ce7-93f9-396b92cd7112]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5] added
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6284ab-184b-4075-a4cb-83f91a144dd4]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96acedfb-1ccc-4a1c-9e38-39c8dea069aa]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBzQPwkt {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBzQPwkt" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c1834-9856-4552-9638-4c1a80298d12]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sBzQPwkt'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbc735-524e-42c3-a7bb-ee54b2045032]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74172b5b-2b23-4afc-90fa-1cb03bd350d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a23f5-12a2-45f4-a2ca-f2cbbe281887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]
Jul 27 12:41:45 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed49017-fa6d-4f5d-854b-bafce433420d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b138e48-1a48-4c44-bced-258362ed9cee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7115f-9d28-4c1c-9b69-bc090e126b7a]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26436383365313732', 'path': '/dev/sdi'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436383365313732', 'path': '/dev/sdi'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.objects.instance [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'flavor' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:41:46 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:46 user nova-compute[70994]:   <source dev="/dev/sdi"/>
Jul 27 12:41:46 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:41:46 user nova-compute[70994]:   <serial>36658d04-fdcc-4983-ba20-f55634bbe3b5</serial>
Jul 27 12:41:46 user nova-compute[70994]: </disk>
Jul 27 12:41:46 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] No VIF found with MAC fa:16:3e:32:92:7a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6530f984-7f6b-44c0-8b97-41c50de0448d tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.167s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG os_brick.utils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d836448d-add4-4655-814b-e7a3e5d4550e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1dd5c7-41ac-4482-a21e-570155f5b9fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0446b1-7af6-42d1-9e92-eb0f7f8e43f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc7b55a-b1b1-4437-bbdf-3274f5d9f7c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:41:47 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:41:48 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c15ba-027f-475e-b2a1-013fcbda06c1]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.utils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:48 user nova-compute[70994]: INFO nova.compute.manager [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Swapping volume 36658d04-fdcc-4983-ba20-f55634bbe3b5 for a1a6125f-53a7-4a01-8f86-a694b1c9dcf9
Jul 27 12:41:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUfbpFLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:48 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:48 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:48 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf733c5-1c28-4284-90fd-eda940022055]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:48 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93175913-904b-4c1e-8a65-e042baf47c47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579] added
Jul 27 12:41:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5362735-b2a2-49a5-a02c-cb67ecbfc5c6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a159367c-1077-4621-bedc-5dc2b524e406]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUfbpFLH {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUfbpFLH" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c3e042-68c4-4de2-a01f-657a8843474e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUfbpFLH'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8aa09e-2a80-4efd-84f6-7a6caec0a13b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dec2b5-22e0-4171-9840-40a65d660ff1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:48 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f6ba2-b83c-43e7-b1b4-27ad999a7a97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260]
Jul 27 12:41:49 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:49 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df8a88-a76b-4819-b7a9-e4b5390e16a8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dad4fb-e44a-4eb1-b5b3-0d10745f9fab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:49 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1024ae-b3b8-415b-a068-11c5fc2e1156]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUfbpFLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26263653864356366', 'path': '/dev/sdj'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263653864356366', 'path': '/dev/sdj'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'flavor' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:41:50 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:50 user nova-compute[70994]:   <source dev="/dev/sdj"/>
Jul 27 12:41:50 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:41:50 user nova-compute[70994]:   <serial>074d16cf-c568-4467-9bbf-4079f0385579</serial>
Jul 27 12:41:50 user nova-compute[70994]: </disk>
Jul 27 12:41:50 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No VIF found with MAC fa:16:3e:47:77:db, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9c3f8417-2c54-4da4-951d-c4db7c620687 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.070s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:51 user nova-compute[70994]: INFO nova.compute.manager [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Detaching volume 074d16cf-c568-4467-9bbf-4079f0385579
Jul 27 12:41:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzxXFjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:51 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7638c01b-c0e2-4ce9-a8a5-5b23c3d9083a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:51 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: INFO nova.virt.block_device [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Attempting to driver detach volume 074d16cf-c568-4467-9bbf-4079f0385579 from mountpoint /dev/vdb
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb793dfe-820e-43fb-9182-9d05c253a02d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530] added
Jul 27 12:41:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Attempting to detach device vdb from instance 5d2440a0-860c-4700-9fed-224851bec304 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:41:51 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:51 user nova-compute[70994]:   <source dev="/dev/sdj"/>
Jul 27 12:41:51 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:41:51 user nova-compute[70994]:   <serial>074d16cf-c568-4467-9bbf-4079f0385579</serial>
Jul 27 12:41:51 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:41:51 user nova-compute[70994]: </disk>
Jul 27 12:41:51 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:41:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully detached device vdb from instance 5d2440a0-860c-4700-9fed-224851bec304 from the persistent domain config.
Jul 27 12:41:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d2440a0-860c-4700-9fed-224851bec304 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:41:51 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:51 user nova-compute[70994]:   <source dev="/dev/sdj"/>
Jul 27 12:41:51 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:41:51 user nova-compute[70994]:   <serial>074d16cf-c568-4467-9bbf-4079f0385579</serial>
Jul 27 12:41:51 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:41:51 user nova-compute[70994]: </disk>
Jul 27 12:41:51 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b09e0-4120-4092-b699-0debcfd86d0b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[efedc546-bab4-4b71-9ba9-47335917b75c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzxXFjGg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzxXFjGg" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a7b18-6a73-4c43-8cfa-b3e3c4b0f1d1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzxXFjGg'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8af5ac-8b72-47ea-b743-4b86153163b0]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[221783ad-d88e-489b-bf93-e00621ba5586]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[344671b3-85d4-41c0-8b77-6558daed0af1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260]
Jul 27 12:41:52 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b122bdeb-6302-4ef0-8f62-3ab30154abae]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75833885-3408-40e6-8831-1790536420f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.043s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a43228-c038-44df-b913-c99c442ff6e1]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzxXFjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690461712.2563527, 5d2440a0-860c-4700-9fed-224851bec304 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:41:52 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully detached device vdb from instance 5d2440a0-860c-4700-9fed-224851bec304 from the live domain config.
Jul 27 12:41:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUfbpFLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:52 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '26633363332376538', 'path': '/dev/sdk'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633363332376538', 'path': '/dev/sdk'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.910s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.objects.instance [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'flavor' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[46386b5a-7015-41eb-bcb5-b34ef229f7e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:41:53 user nova-compute[70994]: No targets found.
Jul 27 12:41:53 user nova-compute[70994]: iSNS:
Jul 27 12:41:53 user nova-compute[70994]: No targets found.
Jul 27 12:41:53 user nova-compute[70994]: STATIC:
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:41:53 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:53 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:53 user nova-compute[70994]: FIRMWARE:
Jul 27 12:41:53 user nova-compute[70994]: No targets found.
Jul 27 12:41:53 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:41:53 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:41:53 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:41:53 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:53 user nova-compute[70994]:   <source dev="/dev/sdk"/>
Jul 27 12:41:53 user nova-compute[70994]:   <target dev="sdc" bus="scsi"/>
Jul 27 12:41:53 user nova-compute[70994]:   <serial>de794d77-90a0-4de9-a815-3a49b88d1530</serial>
Jul 27 12:41:53 user nova-compute[70994]:   <address type="drive" controller="0" unit="2"/>
Jul 27 12:41:53 user nova-compute[70994]: </disk>
Jul 27 12:41:53 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abb4390-9f14-4bb2-a812-16eb3c4f0404]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97966d4-330c-4a0e-8759-ad9f2ba3580c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:53 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f890294c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579'): ({'sdj'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Removing single pathed devices sdj {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8417e202-5235-4a21-aca9-ec5e2ae0e8d5]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fec35c3-e9d0-446c-94c3-7d25255088ce]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Flushing IO for device /dev/sdj {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b16f6-82d9-4406-a8d8-f00716728f38]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0ee1b4-be3b-4353-9954-1a72fb0e440a]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] SCSI volumes sdj have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa095c-4297-4644-b336-723e047303d1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296c646-2d07-4fd9-abd2-4a6fd5bc8143]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260]
Jul 27 12:41:53 user nova-compute[70994]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:53 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:074d16cf-c568-4467-9bbf-4079f0385579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43de75e-91d9-4260-bb19-704fa02b7308]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] <== disconnect_volume: return (1262ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No BDM found with device name sda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] No VIF found with MAC fa:16:3e:5d:5c:d7, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:41:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d2d53bb-9b71-4a63-b88f-422d8edef94a tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.121s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'flavor' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d47424a6-3621-4f04-b19b-f2ae17fd84c7 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.659s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:54 user nova-compute[70994]: INFO nova.compute.manager [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Detaching volume de794d77-90a0-4de9-a815-3a49b88d1530
Jul 27 12:41:54 user nova-compute[70994]: INFO nova.virt.block_device [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Attempting to driver detach volume de794d77-90a0-4de9-a815-3a49b88d1530 from mountpoint /dev/sdc
Jul 27 12:41:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Attempting to detach device sdc from instance d18149ad-4761-4986-9ccf-199b3ef176ae from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:41:54 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:54 user nova-compute[70994]:   <source dev="/dev/sdk"/>
Jul 27 12:41:54 user nova-compute[70994]:   <target dev="sdc" bus="scsi"/>
Jul 27 12:41:54 user nova-compute[70994]:   <serial>de794d77-90a0-4de9-a815-3a49b88d1530</serial>
Jul 27 12:41:54 user nova-compute[70994]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 12:41:54 user nova-compute[70994]: </disk>
Jul 27 12:41:54 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:41:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Successfully detached device sdc from instance d18149ad-4761-4986-9ccf-199b3ef176ae from the persistent domain config.
Jul 27 12:41:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d18149ad-4761-4986-9ccf-199b3ef176ae from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:41:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:41:54 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:41:54 user nova-compute[70994]:   <source dev="/dev/sdk"/>
Jul 27 12:41:54 user nova-compute[70994]:   <target dev="sdc" bus="scsi"/>
Jul 27 12:41:54 user nova-compute[70994]:   <serial>de794d77-90a0-4de9-a815-3a49b88d1530</serial>
Jul 27 12:41:54 user nova-compute[70994]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 12:41:54 user nova-compute[70994]: </disk>
Jul 27 12:41:54 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690461715.016815, d18149ad-4761-4986-9ccf-199b3ef176ae => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:41:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Successfully detached device sdc from instance d18149ad-4761-4986-9ccf-199b3ef176ae from the live domain config.
Jul 27 12:41:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzxXFjGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:55 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1013f-76ef-47cb-8e11-5bb817e736aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:41:55 user nova-compute[70994]: No targets found.
Jul 27 12:41:55 user nova-compute[70994]: iSNS:
Jul 27 12:41:55 user nova-compute[70994]: No targets found.
Jul 27 12:41:55 user nova-compute[70994]: STATIC:
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:41:55 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:41:55 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:41:55 user nova-compute[70994]: FIRMWARE:
Jul 27 12:41:55 user nova-compute[70994]: No targets found.
Jul 27 12:41:55 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:41:55 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:41:55 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9055f-9393-451b-9df2-b5a01b77fffc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d02883-778a-4b33-acfa-f4fa55a7e8af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:55 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8902850310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530'): ({'sdk'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Removing single pathed devices sdk {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d84bbb-af26-40b8-a2d6-70fbfa617f36]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f404101d-a000-49d2-902f-a641fa1f1441]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Flushing IO for device /dev/sdk {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2ce3e-5c9e-46ac-ad13-526b6c71c7d6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[58739b9d-e05f-4e99-a48a-11421f732cc5]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] SCSI volumes sdk have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa56038-97bb-4bab-84ac-bb7403edd8b9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b91f7-c8de-483d-bc71-b973575607d4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260]
Jul 27 12:41:55 user nova-compute[70994]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:55 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de794d77-90a0-4de9-a815-3a49b88d1530 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5ded35-781b-4e1b-81ee-6b36310256c4]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] <== disconnect_volume: return (361ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'serial': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': '36658d04-fdcc-4983-ba20-f55634bbe3b5', 'serial'} {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:41:56 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:56 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:41:56 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbe9d4d-fa7c-471f-b50a-159e1bee7d7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:41:56 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d99c0-29d6-44f1-b73f-7fd7452ce2ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9] added
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ac1d5-6d6b-4154-906b-d12dd7cbfb2a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8009073b-fbe0-489e-91c0-cabe281369f2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NdmTFADf {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NdmTFADf" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44cbcc-291c-433a-9be5-5d8069b4d179]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NdmTFADf'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e561fef-1930-47de-b5f4-565e0661e5c9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a701a-1bda-45ce-b3c7-a2c0009830de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e2b33-cc45-401a-9ed9-dfae0f696057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260]
Jul 27 12:41:56 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260] successful.
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95209f-d4ec-43c9-9bf1-cbc532026322]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG nova.objects.instance [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'flavor' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a8be8-1754-4b9a-9b11-891d9256df6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:41:56 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78f67f0f-cbf4-4566-8767-d93977aa7149 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.867s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b64ba-2573-43c6-80bf-d512739a0bf0]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:41:56 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: INFO nova.compute.manager [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Terminating instance
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23037323233633866', 'path': '/dev/sdj'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037323233633866', 'path': '/dev/sdj'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lazy-loading 'flavor' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-unplugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] No waiting events found dispatching network-vif-unplugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-efff6794-56c7-4ed7-815a-ff50c0260bf7 req-74f88fc5-3a69-4560-b8c0-4fd7e1a5702f service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-unplugged-5a0a980b-1231-42d9-9799-984ef056eb33 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Instance destroyed successfully.
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lazy-loading 'resources' on Instance uuid d18149ad-4761-4986-9ccf-199b3ef176ae {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1892611148',display_name='tempest-AttachSCSIVolumeTestJSON-server-1892611148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1892611148',id=11,image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOxWDq/QyVSj+WzV59OS6qYdS7uL3f+xsY/HrWbEFzT/rBrwyr+D4hdqW1901J5baYUHIp47PN0j6f6W0jaxR26QFlXpymIe2OlW+BviPQCSS36cju8Jb/8N+34icMJsQ==',key_name='tempest-keypair-1951567509',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c69fffed844249eb87e5f73f4fc862c0',ramdisk_id='',reservation_id='r-shru7umq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7ee54a31-b3d3-42df-9e6e-5f6862bb27cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1475755362',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1475755362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d3857a4640c4ae4a30c3ea57735e23c',uuid=d18149ad-4761-4986-9ccf-199b3ef176ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converting VIF {"id": "5a0a980b-1231-42d9-9799-984ef056eb33", "address": "fa:16:3e:5d:5c:d7", "network": {"id": "acf30a1b-7738-4ecc-b6af-3dc69dd8ad66", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1585809416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69fffed844249eb87e5f73f4fc862c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0a980b-12", "ovs_interfaceid": "5a0a980b-1231-42d9-9799-984ef056eb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG os_vif [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a0a980b-12, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:41:58 user nova-compute[70994]: INFO os_vif [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:5c:d7,bridge_name='br-int',has_traffic_filtering=True,id=5a0a980b-1231-42d9-9799-984ef056eb33,network=Network(acf30a1b-7738-4ecc-b6af-3dc69dd8ad66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0a980b-12')
Jul 27 12:41:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Deleting instance files /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae_del
Jul 27 12:41:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Deletion of /opt/stack/data/nova/instances/d18149ad-4761-4986-9ccf-199b3ef176ae_del complete
Jul 27 12:41:58 user nova-compute[70994]: INFO nova.compute.manager [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 27 12:41:58 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:41:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 189792256 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 205520896 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-22574f76-7f3b-4e51-8e92-7c7c4c876406 req-08c9aa35-55d0-4f8d-a2a3-be939ff2a610 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-deleted-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:59 user nova-compute[70994]: INFO nova.compute.manager [req-22574f76-7f3b-4e51-8e92-7c7c4c876406 req-08c9aa35-55d0-4f8d-a2a3-be939ff2a610 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Neutron deleted interface 5a0a980b-1231-42d9-9799-984ef056eb33; detaching it from the instance and deleting it from the info cache
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.network.neutron [req-22574f76-7f3b-4e51-8e92-7c7c4c876406 req-08c9aa35-55d0-4f8d-a2a3-be939ff2a610 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:41:59 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Took 1.29 seconds to deallocate network for instance.
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] Acquiring lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] No waiting events found dispatching network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:41:59 user nova-compute[70994]: WARNING nova.compute.manager [req-6b5b2e33-5e24-4078-ad80-59d670a9b934 req-f7989eb2-8a7c-4ebb-aa56-29b96e9b9281 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Received unexpected event network-vif-plugged-5a0a980b-1231-42d9-9799-984ef056eb33 for instance with vm_state active and task_state deleting.
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-22574f76-7f3b-4e51-8e92-7c7c4c876406 req-08c9aa35-55d0-4f8d-a2a3-be939ff2a610 service nova] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Detach interface failed, port_id=5a0a980b-1231-42d9-9799-984ef056eb33, reason: Instance d18149ad-4761-4986-9ccf-199b3ef176ae could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 369098752 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:41:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 522190848 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:00 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:00 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.583s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:00 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Deleted allocations for instance d18149ad-4761-4986-9ccf-199b3ef176ae
Jul 27 12:42:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1be3806c-aaf0-4571-8cfc-4ed21087e787 tempest-AttachSCSIVolumeTestJSON-1475755362 tempest-AttachSCSIVolumeTestJSON-1475755362-project-member] Lock "d18149ad-4761-4986-9ccf-199b3ef176ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.486s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 702545920 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 1009778688 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:02 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0cc833-1699-414d-b4c8-bca5a7a53c83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:02 user nova-compute[70994]: No targets found.
Jul 27 12:42:02 user nova-compute[70994]: iSNS:
Jul 27 12:42:02 user nova-compute[70994]: No targets found.
Jul 27 12:42:02 user nova-compute[70994]: STATIC:
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:02 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:02 user nova-compute[70994]: No targets found.
Jul 27 12:42:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:02 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:02 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c267ef7-e91b-4cb1-be93-c3426274aee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c26500-d554-4c49-b2b2-d69a7d881668]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4317d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5'): ({'sdi'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Removing single pathed devices sdi {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e510c50-4170-445d-84d1-5f2b5405a1ce]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dafd99e-1f5a-4959-8372-a3a88c96bc89]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Flushing IO for device /dev/sdi {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7669c-5c63-4bd5-a6df-9d6c1e4b666b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd3f317-6f4d-4797-bc8d-c8b402fd5fa2]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] SCSI volumes sdi have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f303f52f-a439-4a6e-b239-6d174f38d039]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[80364d73-6bcd-4fac-9089-8d185346d93d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]
Jul 27 12:42:02 user nova-compute[70994]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ae0b03-d721-4aea-ae0e-bd28eea4d65a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== disconnect_volume: return (347ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'serial'} {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 12:42:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: removing Cinder connection for volume 36658d04-fdcc-4983-ba20-f55634bbe3b5 {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 12:42:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:03 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: Updating volume 36658d04-fdcc-4983-ba20-f55634bbe3b5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NdmTFADf", "auth_password": "KABNnG4e0fR9PS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "a1a6125f-53a7-4a01-8f86-a694b1c9dcf9"}, "status": "reserved", "instance": "662c50c8-4f10-4cc1-b537-cf31dde13cca", "attached_at": "", "detached_at": "", "volume_id": "a1a6125f-53a7-4a01-8f86-a694b1c9dcf9", "serial": "a1a6125f-53a7-4a01-8f86-a694b1c9dcf9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'no_device': None, 'attachment_id': '4f3f6ebe-e922-445b-8887-e08c64159932'} {{(pid=70994) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 12:42:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9381ac5b-4ec0-40a3-9f5a-ad4012a31486 tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.921s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.utils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da3f29-0def-4498-af1a-2aecf0c51441]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d9f94-dcbf-453a-b282-92c6ccec33b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b102de71-aa49-4ec7-8f9c-6561d4133094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cddcfd3-4906-4223-939d-7647bc47d52c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:42:04 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:42:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[716937e8-c941-48f0-ac93-b832dfdf084d]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:42:04 user nova-compute[70994]: DEBUG os_brick.utils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:04 user nova-compute[70994]: INFO nova.compute.manager [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Swapping volume a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 for 36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:42:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': '36658d04-fdcc-4983-ba20-f55634bbe3b5', 'serial': '36658d04-fdcc-4983-ba20-f55634bbe3b5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9'}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'serial'} {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:12 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:12 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:12 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca936eb-b3fd-491e-99c4-5fe9e9527085]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:42:12 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85c2b1-c9bb-47f3-9508-149f5779d7f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5] added
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caf7aec-692f-41d0-973d-de4aeca444b3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9875696-7dba-4cda-b991-e5fd21db740d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBzQPwkt {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBzQPwkt" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[481de4f1-7563-4377-a435-f177ed34bfd7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sBzQPwkt'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ffd4e-5a0b-4615-82f1-d07c01e32979]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e23914-f71f-4b17-a6d2-3e33d3ab47cb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[77418d1a-0dcc-47b0-b3d5-b855d59e2172]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]
Jul 27 12:42:12 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcace29-d079-465e-985a-080e6b0e9025]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55532f4-acd5-46fa-9ab0-cab4c6daa056]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:12 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ecd976-0763-4628-a5c9-1b68aea54594]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:42:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461718.1485527, d18149ad-4761-4986-9ccf-199b3ef176ae => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:42:13 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] VM Stopped (Lifecycle Event)
Jul 27 12:42:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-66ace5da-c8ff-42ce-b30b-a4d86c85603b None None] [instance: d18149ad-4761-4986-9ccf-199b3ef176ae] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26436383365313732', 'path': '/dev/sdi'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436383365313732', 'path': '/dev/sdi'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:42:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lazy-loading 'flavor' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 227540992 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-changed-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing instance network info cache due to event network-changed-8b14d748-e776-4d6f-87d7-64d82f9fd27a. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] Acquiring lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] Acquired lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG nova.network.neutron [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Refreshing network info cache for port 8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 455081984 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 614465536 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updated VIF entry in instance network info cache for port 8b14d748-e776-4d6f-87d7-64d82f9fd27a. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73985024-7867-44a5-9fa0-5c57f9216abe req-58fc0dee-f88f-4dbe-8a47-357ac7c21a8d service nova] Releasing lock "refresh_cache-b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 810549248 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 936378368 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-changed-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing instance network info cache due to event network-changed-f8924976-f987-42b4-a080-b635ce4fefc3. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] Acquiring lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] Acquired lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.network.neutron [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Refreshing network info cache for port f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NdmTFADf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'a1a6125f-53a7-4a01-8f86-a694b1c9dcf9'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9c3d7c-d1ed-4470-b2e1-1e7ee6254a31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:18 user nova-compute[70994]: No targets found.
Jul 27 12:42:18 user nova-compute[70994]: iSNS:
Jul 27 12:42:18 user nova-compute[70994]: No targets found.
Jul 27 12:42:18 user nova-compute[70994]: STATIC:
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:18 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:18 user nova-compute[70994]: No targets found.
Jul 27 12:42:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:18 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:18 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35122d98-cf4c-4895-88d6-dd028ef5b30e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319d94b-7d93-4d05-8540-a7b202ff87b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f890294dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9'): ({'sdj'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Removing single pathed devices sdj {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ae2ec-068d-46da-95b3-4234482a1d50]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a6a5c-3b4a-47d1-b107-a439d3963f10]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Flushing IO for device /dev/sdj {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1baae1b-ad62-4350-8486-9bce002a6af5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[70449737-d45e-405d-a1da-0f6c77f14b0c]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] SCSI volumes sdj have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.network.neutron [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updated VIF entry in instance network info cache for port f8924976-f987-42b4-a080-b635ce4fefc3. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.network.neutron [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f867dc-db21-43d0-8714-b29474eea8a1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd33ba04-e39e-420a-a74f-ece6ce74540a req-ed50cde0-6fbe-4311-bea2-c4580a0a27d1 service nova] Releasing lock "refresh_cache-c7fb777c-fae8-438d-a339-478ed2f8cb49" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07751ab4-8e7d-43c9-b21a-8a5c07074eb5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260]
Jul 27 12:42:19 user nova-compute[70994]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331297e-73a6-42e9-aed9-defc908ffac8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] <== disconnect_volume: return (394ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '662c50c8-4f10-4cc1-b537-cf31dde13cca', 'attached_at': '', 'detached_at': '', 'volume_id': '36658d04-fdcc-4983-ba20-f55634bbe3b5', 'serial'} {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: removing Cinder connection for volume a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 {{(pid=70994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:19 user nova-compute[70994]: INFO nova.compute.manager [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Terminating instance
Jul 27 12:42:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] swap_volume: Updating volume a1a6125f-53a7-4a01-8f86-a694b1c9dcf9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sBzQPwkt", "auth_password": "zDO1YG8Hn3JVxo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "36658d04-fdcc-4983-ba20-f55634bbe3b5"}, "status": "reserved", "instance": "662c50c8-4f10-4cc1-b537-cf31dde13cca", "attached_at": "", "detached_at": "", "volume_id": "36658d04-fdcc-4983-ba20-f55634bbe3b5", "serial": "36658d04-fdcc-4983-ba20-f55634bbe3b5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '36658d04-fdcc-4983-ba20-f55634bbe3b5', 'no_device': None, 'attachment_id': 'c633670a-3fdd-4ab2-92d9-d9242ad31bf0'} {{(pid=70994) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3244c777-2c59-412f-9d84-ce0bdd5b821b tempest-TestVolumeSwap-1483567742 tempest-TestVolumeSwap-1483567742-project-admin] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.906s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-3761be6b-fcc6-4ece-a424-44b1aa8d9438 req-7a60dac4-95b2-403e-bde6-678e60af93c7 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-e86b03ab-2325-43d8-96af-1ed082aba0d2 req-942a81e8-66f0-443f-83c8-ac48ee756fdd service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-009fb871-9525-4d77-8c8b-e8ded2b655c7 req-d46fa132-1465-4ff2-81dd-8dbecbf08044 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:21 user nova-compute[70994]: INFO nova.compute.manager [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Detaching volume 36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:42:21 user nova-compute[70994]: INFO nova.virt.block_device [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Attempting to driver detach volume 36658d04-fdcc-4983-ba20-f55634bbe3b5 from mountpoint /dev/vdb
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Attempting to detach device vdb from instance 662c50c8-4f10-4cc1-b537-cf31dde13cca from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:42:21 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:42:21 user nova-compute[70994]:   <source dev="/dev/sdi"/>
Jul 27 12:42:21 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:42:21 user nova-compute[70994]:   <serial>36658d04-fdcc-4983-ba20-f55634bbe3b5</serial>
Jul 27 12:42:21 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:42:21 user nova-compute[70994]: </disk>
Jul 27 12:42:21 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:42:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Successfully detached device vdb from instance 662c50c8-4f10-4cc1-b537-cf31dde13cca from the persistent domain config.
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 662c50c8-4f10-4cc1-b537-cf31dde13cca from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:42:21 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:42:21 user nova-compute[70994]:   <source dev="/dev/sdi"/>
Jul 27 12:42:21 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:42:21 user nova-compute[70994]:   <serial>36658d04-fdcc-4983-ba20-f55634bbe3b5</serial>
Jul 27 12:42:21 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:42:21 user nova-compute[70994]: </disk>
Jul 27 12:42:21 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:21 user nova-compute[70994]: INFO nova.compute.manager [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Terminating instance
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:42:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Instance destroyed successfully.
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lazy-loading 'resources' on Instance uuid b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b14d748-e7, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:75:3b,bridge_name='br-int',has_traffic_filtering=True,id=8b14d748-e776-4d6f-87d7-64d82f9fd27a,network=Network(57074e77-8214-4b21-a301-f1c1e594b49a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b14d748-e7')
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap657dedfb-d8, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690461742.2465246, 662c50c8-4f10-4cc1-b537-cf31dde13cca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:42:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Successfully detached device vdb from instance 662c50c8-4f10-4cc1-b537-cf31dde13cca from the live domain config.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBzQPwkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '36658d04-fdcc-4983-ba20-f55634bbe3b5'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdda6614-845b-4944-9ac8-757901522682]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:22 user nova-compute[70994]: No targets found.
Jul 27 12:42:22 user nova-compute[70994]: iSNS:
Jul 27 12:42:22 user nova-compute[70994]: No targets found.
Jul 27 12:42:22 user nova-compute[70994]: STATIC:
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:22 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:22 user nova-compute[70994]: No targets found.
Jul 27 12:42:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:22 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:22 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa183792-3f64-4237-b881-685efd4e998e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd059dc1-c486-4067-8a77-b595a87b90e1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88fc2b2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5'): ({'sdi'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Removing single pathed devices sdi {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[584dbea9-89d2-41b7-a74c-89afd8bc8dc6]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3265a-1a02-4b31-92f2-8b89e6dbf82a]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Flushing IO for device /dev/sdi {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c77861e-896d-4336-9dca-5773f02cb6cc]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:09:d6,bridge_name='br-int',has_traffic_filtering=True,id=657dedfb-d8e8-4675-856c-dc0bbd13a2e1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap657dedfb-d8')
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48fc0163-4e, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3f15d2-36c1-4a56-9eff-05e332e891ee]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] SCSI volumes sdi have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d155b-8e16-4f4c-87c5-13efe9f88398]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-8b14d748-e776-4d6f-87d7-64d82f9fd27a for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-9fac624e-a936-4fb2-926e-607718182a9a req-0617a5f9-69bd-4b14-b653-6eb677f069df service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-657dedfb-d8e8-4675-856c-dc0bbd13a2e1 for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f07ef-08cc-4f9b-b293-be721fdc4cec]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260]
Jul 27 12:42:22 user nova-compute[70994]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36658d04-fdcc-4983-ba20-f55634bbe3b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7661cc3-c7f5-4899-a929-8b39373c52ab]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] <== disconnect_volume: return (461ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:bc:04,bridge_name='br-int',has_traffic_filtering=True,id=48fc0163-4e5a-4ffc-915e-25f8482d78a1,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48fc0163-4e')
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-48fc0163-4e5a-4ffc-915e-25f8482d78a1 for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-16c11948-6864-466d-ac7e-b7d87c0057aa for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-16c11948-6864-466d-ac7e-b7d87c0057aa for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-f8924976-f987-42b4-a080-b635ce4fefc3 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:22 user nova-compute[70994]: WARNING nova.compute.manager [req-e3b3cc36-30ea-40f4-a5e0-9e24ace7bdaf req-b4cfdbf4-8b40-40fb-b12e-ebbdf2b51cd6 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-f8924976-f987-42b4-a080-b635ce4fefc3 for instance with vm_state active and task_state deleting.
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c11948-68, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:be:2c,bridge_name='br-int',has_traffic_filtering=True,id=16c11948-6864-466d-ac7e-b7d87c0057aa,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c11948-68')
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6983ee02-7d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:23 user nova-compute[70994]: WARNING nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-6983ee02-7d34-4cff-a7be-8aaf2352b907 for instance with vm_state active and task_state deleting.
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-unplugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-unplugged-ef1461ee-5288-4255-be42-001889dccbd5 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Acquiring lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] No waiting events found dispatching network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:23 user nova-compute[70994]: WARNING nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received unexpected event network-vif-plugged-ef1461ee-5288-4255-be42-001889dccbd5 for instance with vm_state active and task_state deleting.
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-9ee9b8be-fb27-4677-924e-038b96735a35 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:23 user nova-compute[70994]: WARNING nova.compute.manager [req-2e4bc339-e711-415e-b7ed-4620b08fa9ae req-e344c70f-41d9-4d69-a828-05db98989042 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-9ee9b8be-fb27-4677-924e-038b96735a35 for instance with vm_state active and task_state deleting.
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:8e:10,bridge_name='br-int',has_traffic_filtering=True,id=6983ee02-7d34-4cff-a7be-8aaf2352b907,network=Network(6dfa1d49-0df7-4168-a7d1-301f43a4ad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6983ee02-7d')
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "address": "fa:16:3e:38:ad:11", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8314f9-df", "ovs_interfaceid": "7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f8314f9-df, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ad:11,bridge_name='br-int',has_traffic_filtering=True,id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8314f9-df')
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-421700455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-421700455',id=12,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIICpPs56ywkPedRUILQOag8TqrUtBFbc7FWHMAS3AaAIMMLA2aJCywbHYq4IjGZ+Uhyo2VEkEXdqEK9Vysu3WJmjUU31sFYr+oqr8CPSQj88CYeEDj24ijpw/27dmh5+g==',key_name='tempest-keypair-133815060',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b0a7eb226524d17aa02c7f0d35be501',ramdisk_id='',reservation_id='r-ygchlril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1690118915',owner_user_name='tempest-TaggedBootDevicesTest-1690118915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7fcfe35145a46e28da123047cccddd8',uuid=b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converting VIF {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1461ee-52, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'flavor' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: INFO os_vif [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=ef1461ee-5288-4255-be42-001889dccbd5,network=Network(303b47d3-27e1-4bbe-b73b-f0283b3cfd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1461ee-52')
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0ba7c74c-00c1-4b8e-a137-6677135e078a tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.428s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMIVaXug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:23 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Instance destroyed successfully.
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lazy-loading 'resources' on Instance uuid c7fb777c-fae8-438d-a339-478ed2f8cb49 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711261c-c613-4522-b9b8-d9c5fe965f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:23 user nova-compute[70994]: No targets found.
Jul 27 12:42:23 user nova-compute[70994]: iSNS:
Jul 27 12:42:23 user nova-compute[70994]: No targets found.
Jul 27 12:42:23 user nova-compute[70994]: STATIC:
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:23 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:23 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:23 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:23 user nova-compute[70994]: No targets found.
Jul 27 12:42:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:23 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:23 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8924976-f9, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004d14f-1ea0-44e3-b24c-d1065491c244]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0067d77-a85f-4026-8a9a-193a99a91054]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89028523b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b7:c6,bridge_name='br-int',has_traffic_filtering=True,id=f8924976-f987-42b4-a080-b635ce4fefc3,network=Network(7ddf30b0-f657-458a-bd6a-7c3db9730d3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8924976-f9')
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ee9b8be-fb, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d53360-1168-4065-93d8-08b0b32c52ee]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f5ef2b-b3ee-4667-bbf2-9858c98973db]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:45:9c,bridge_name='br-int',has_traffic_filtering=True,id=9ee9b8be-fb27-4677-924e-038b96735a35,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ee9b8be-fb')
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26264d-7b1f-4bd2-8126-2eee46743fc5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd657fe94-5d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b514b7-ebde-452e-bab8-2bb1789748ab]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:24 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:2e,bridge_name='br-int',has_traffic_filtering=True,id=d657fe94-5dfc-4f2b-b23a-f13056d986c1,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd657fe94-5d')
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b3e3584-99, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f446d7d-c65e-4cef-892f-e1c4d9b983e5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:0c,bridge_name='br-int',has_traffic_filtering=True,id=3b3e3584-994e-440b-81b3-1d6a5fc98923,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3e3584-99')
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92b87fcb-1b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e5:d6,bridge_name='br-int',has_traffic_filtering=True,id=92b87fcb-1b9b-45d7-bcd9-b71f78b22b49,network=Network(cfe1f920-ce52-49e2-8979-cfa208b72673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b87fcb-1b')
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "address": "fa:16:3e:27:9f:1c", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef56aaf1-08", "ovs_interfaceid": "ef56aaf1-08ae-49d6-b8a3-296ebc3ca309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef56aaf1-08, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9f:1c,bridge_name='br-int',has_traffic_filtering=True,id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef56aaf1-08')
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1478542775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1478542775',id=13,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBESZwyoEuFFozOLBg1bDr3AuBwzR9/zDeG9krOUliOJfLrmLMkF/0Th7zw98wTVzqXrK/6rTuN1tQwD9JAx9T+O5gJRdJ9DdKzNorElnDVLyRUZq1ZEdh5WOPxgn9xuGw==',key_name='tempest-keypair-1520692779',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11cb33350f040b3b248a84b3746235e',ramdisk_id='',reservation_id='r-v60u6aze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-409814752',owner_user_name='tempest-TaggedBootDevicesTest_v242-409814752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a965dc4584244ec2b2c577799bf79f19',uuid=c7fb777c-fae8-438d-a339-478ed2f8cb49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converting VIF {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc495d56-5c, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:24 user nova-compute[70994]: INFO os_vif [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:20,bridge_name='br-int',has_traffic_filtering=True,id=bc495d56-5cc3-4e23-b0c8-7a18b582df31,network=Network(895b5406-13c6-46cd-8490-3ddbc248618b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc495d56-5c')
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCaDfOIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f72e7e0-2048-4113-9dc5-b28465a9db3f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260]
Jul 27 12:42:24 user nova-compute[70994]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a75505b-c2d4-4ffb-8b99-f2a9b423eb96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a076a6-ee14-4ece-b309-6eb9a55eb3a1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== disconnect_volume: return (405ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.041s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPIpmqLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839b6e1-55be-494c-9b90-5587db9270d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: iSNS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: STATIC:
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:24 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c93c42-57ed-499b-befe-439842d0678e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[971fe5ac-fdea-4964-93b3-35f5f7b96a27]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88fc110f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f49e7d-4935-4dab-a033-1760e6be2950]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb8f07-cc7e-433a-b6c4-86146181fc83]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79738e0-236f-4f91-86cb-657848e59a15]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6efe52a-7a3b-43c9-991d-c960ec306141]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e19f87-3823-4d6e-bfc3-74caf7b8d5d8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3896a1-11aa-4f42-84ba-09382e77887f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260]
Jul 27 12:42:24 user nova-compute[70994]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028cbbd8-dfd7-451a-9604-39c350d0edd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20726b71-792b-4845-a67b-180e5ce084b7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== disconnect_volume: return (360ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.318s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQWKVXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afe1c9-6b3e-4a34-ac2d-c82ae7d48616]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: iSNS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: STATIC:
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:24 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021af14-c972-4682-9a9f-814b287ef4b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368a3c0-d57a-4050-b9df-4756beadb3d9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88fc110f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85584547-40d0-4263-a1c8-18e3fbfe3989]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING nova.compute.manager [req-b59ec45f-0c7a-49fd-8d37-bea4f8acde39 req-70c21296-429b-4091-8330-6f5837691716 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-3b3e3584-994e-440b-81b3-1d6a5fc98923 for instance with vm_state active and task_state deleting.
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6ab06-8bc2-496c-b7ab-a930cc03d44d]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8909e-b214-4323-8039-7547f8875124]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae3918-1b0e-45dd-a42b-a79a6ed6cf0f]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f97c73-fc69-4b62-912a-be6430e46628]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9f8f5-db7b-4de0-8f7f-d0deaf0be546]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260]
Jul 27 12:42:24 user nova-compute[70994]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61d502b2-09fc-4bba-82e4-d4fa62bcf0c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c58c9-2f8b-4240-94ec-f4d55580a99a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== disconnect_volume: return (630ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.310s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'einVrplB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 for instance with vm_state active and task_state deleting.
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:24 user nova-compute[70994]: WARNING nova.compute.manager [req-16c5df34-495a-4cd6-a294-df53d58984dc req-b5e4e4bb-5e04-4ca1-83f7-7bbfae44a6b5 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-bc495d56-5cc3-4e23-b0c8-7a18b582df31 for instance with vm_state active and task_state deleting.
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e516b5-c598-4a4d-b26d-6e2642af7dbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: iSNS:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]: STATIC:
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:24 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:24 user nova-compute[70994]: No targets found.
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:24 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:24 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867bf25-dce0-4679-8d37-c666c86ea89b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7293b2f6-d76b-45d6-94c5-dc57505211ec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4129c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88'): ({'sdg'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Removing single pathed devices sdg {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6435467-23f3-49cf-8243-903ad1947699]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dabd963-4a7f-43ba-90e9-b67023e0873b]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Flushing IO for device /dev/sdg {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063c59f-92bf-44f8-966f-5b8611b73cee]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4231a2-aac6-4ca0-98af-3496d90604ce]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] SCSI volumes sdg have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f9ab6-54f7-47c9-a08e-e3bc3d99262f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:25 user nova-compute[70994]: WARNING nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-d657fe94-5dfc-4f2b-b23a-f13056d986c1 for instance with vm_state active and task_state deleting.
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-unplugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-unplugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Acquiring lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] No waiting events found dispatching network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:25 user nova-compute[70994]: WARNING nova.compute.manager [req-1bd7e2c2-7df8-413f-86e9-a467de3c19af req-1c313b11-7684-474f-9475-411593c152fa service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received unexpected event network-vif-plugged-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 for instance with vm_state active and task_state deleting.
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a6e32-02f7-4072-9599-31efc21e681e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260]
Jul 27 12:42:25 user nova-compute[70994]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c55f37e-1dd1-4970-99b3-8f4d73a62f88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9d6c0-bacb-4ca6-ab14-ece4b759011a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== disconnect_volume: return (627ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.315s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NsDGFMmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:42:25 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d99f44-e5f5-4201-9ed7-56d7115c707a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]: iSNS:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]: STATIC:
Jul 27 12:42:25 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549
Jul 27 12:42:25 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:25 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:25 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:25 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:25 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:25 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:25 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:25 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:25 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:25 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:25 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624702f-d4a4-47d5-a76d-46ff73ff0a9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c193ff4-8ac8-4a2e-92de-89150db1487c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88fc110f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549'): ({'sdc'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Removing single pathed devices sdc {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71708549-9b1e-47b0-b5eb-4dd1623f5805]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d00e7-0022-4ec7-83d5-4a75732d4f95]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Flushing IO for device /dev/sdc {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[279e56d1-baa6-4d96-8eb5-f7e24e393d74]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73271a1-c21e-40a2-a9ea-f859b2120abf]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] SCSI volumes sdc have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf0af0b-ea75-474f-bee2-5192382047a7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7fe63-5c6b-475c-a1f5-12347e0957f1]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260]
Jul 27 12:42:25 user nova-compute[70994]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a057cc88-75fb-4c68-9e85-13bcd989e549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[72676a74-03d0-4d4c-98aa-8337f9f21a05]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] <== disconnect_volume: return (612ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Deleting instance files /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c_del
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Deletion of /opt/stack/data/nova/instances/b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c_del complete
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.297s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6986d0f-26ca-4e1f-88a5-e3856150da7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]: iSNS:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]: STATIC:
Jul 27 12:42:25 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d
Jul 27 12:42:25 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:25 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:25 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:42:25 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:42:25 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:42:25 user nova-compute[70994]: FIRMWARE:
Jul 27 12:42:25 user nova-compute[70994]: No targets found.
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:42:25 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:42:25 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45fcca7-a95c-4376-88a4-ebc3aebef4d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d090afa4-7a6f-4417-a11d-42d9a57b8060]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d (non-flash)
Jul 27 12:42:25 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f890294feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d'): ({'sdf'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Removing single pathed devices sdf {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.compute.manager [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Took 5.55 seconds to destroy the instance on the hypervisor.
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a26b4-353a-46fa-acaa-f8d58ce82b37]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c56811d-bfd5-441f-bc8b-836ede69a880]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Flushing IO for device /dev/sdf {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d9aa8-f022-4bdb-9669-2b01722e20bf]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479faee-a5b5-4e57-86f5-b798be586d18]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] SCSI volumes sdf have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c89a6-b7f4-41c2-98f1-1c3bcca7ce53]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6cb7d0-86f5-448c-88cb-a0be3f5f52e8]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260]
Jul 27 12:42:25 user nova-compute[70994]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d, portal: 172.16.0.220,3260] successful.
Jul 27 12:42:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df9ccaa0-8458-4f71-a2d6-0378048a2b0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6bda4-5ec2-4e0a-a4b2-f6a8167d1c75]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] <== disconnect_volume: return (661ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Deleting instance files /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49_del
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Deletion of /opt/stack/data/nova/instances/c7fb777c-fae8-438d-a339-478ed2f8cb49_del complete
Jul 27 12:42:25 user nova-compute[70994]: INFO nova.compute.manager [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Took 4.15 seconds to destroy the instance on the hypervisor.
Jul 27 12:42:25 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:42:25 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:42:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-2782330e-38b6-4cd6-98e0-0d28ffb41d9e req-f1366220-9198-4616-a7e8-e551b53c11b6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-deleted-7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:27 user nova-compute[70994]: INFO nova.compute.manager [req-2782330e-38b6-4cd6-98e0-0d28ffb41d9e req-f1366220-9198-4616-a7e8-e551b53c11b6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Neutron deleted interface 7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0; detaching it from the instance and deleting it from the info cache
Jul 27 12:42:27 user nova-compute[70994]: DEBUG nova.network.neutron [req-2782330e-38b6-4cd6-98e0-0d28ffb41d9e req-f1366220-9198-4616-a7e8-e551b53c11b6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "address": "fa:16:3e:39:8e:10", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6983ee02-7d", "ovs_interfaceid": "6983ee02-7d34-4cff-a7be-8aaf2352b907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-2782330e-38b6-4cd6-98e0-0d28ffb41d9e req-f1366220-9198-4616-a7e8-e551b53c11b6 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Detach interface failed, port_id=7f8314f9-dfb4-4ec0-a3ce-e1b3942e73e0, reason: Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:42:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-b4c197f4-c819-4b78-a70a-6170dc5e902e req-bc998199-cbbb-4b0d-b099-dde6a11d1629 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-deleted-ef56aaf1-08ae-49d6-b8a3-296ebc3ca309 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:28 user nova-compute[70994]: INFO nova.compute.manager [req-b4c197f4-c819-4b78-a70a-6170dc5e902e req-bc998199-cbbb-4b0d-b099-dde6a11d1629 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Neutron deleted interface ef56aaf1-08ae-49d6-b8a3-296ebc3ca309; detaching it from the instance and deleting it from the info cache
Jul 27 12:42:28 user nova-compute[70994]: DEBUG nova.network.neutron [req-b4c197f4-c819-4b78-a70a-6170dc5e902e req-bc998199-cbbb-4b0d-b099-dde6a11d1629 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [{"id": "f8924976-f987-42b4-a080-b635ce4fefc3", "address": "fa:16:3e:da:b7:c6", "network": {"id": "7ddf30b0-f657-458a-bd6a-7c3db9730d3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1300419557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8924976-f9", "ovs_interfaceid": "f8924976-f987-42b4-a080-b635ce4fefc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ee9b8be-fb27-4677-924e-038b96735a35", "address": "fa:16:3e:b4:45:9c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee9b8be-fb", "ovs_interfaceid": "9ee9b8be-fb27-4677-924e-038b96735a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "address": "fa:16:3e:6f:71:2e", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd657fe94-5d", "ovs_interfaceid": "d657fe94-5dfc-4f2b-b23a-f13056d986c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "address": "fa:16:3e:39:1d:0c", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3e3584-99", "ovs_interfaceid": "3b3e3584-994e-440b-81b3-1d6a5fc98923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "address": "fa:16:3e:c4:e5:d6", "network": {"id": "cfe1f920-ce52-49e2-8979-cfa208b72673", "bridge": "br-int", "label": "tempest-device-tagging-net1-1438197483", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b87fcb-1b", "ovs_interfaceid": "92b87fcb-1b9b-45d7-bcd9-b71f78b22b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "address": "fa:16:3e:47:49:20", "network": {"id": "895b5406-13c6-46cd-8490-3ddbc248618b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1043119207", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e11cb33350f040b3b248a84b3746235e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc495d56-5c", "ovs_interfaceid": "bc495d56-5cc3-4e23-b0c8-7a18b582df31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-b4c197f4-c819-4b78-a70a-6170dc5e902e req-bc998199-cbbb-4b0d-b099-dde6a11d1629 service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Detach interface failed, port_id=ef56aaf1-08ae-49d6-b8a3-296ebc3ca309, reason: Instance c7fb777c-fae8-438d-a339-478ed2f8cb49 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-deleted-6983ee02-7d34-4cff-a7be-8aaf2352b907 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:29 user nova-compute[70994]: INFO nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Neutron deleted interface 6983ee02-7d34-4cff-a7be-8aaf2352b907; detaching it from the instance and deleting it from the info cache
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef1461ee-5288-4255-be42-001889dccbd5", "address": "fa:16:3e:c9:d5:50", "network": {"id": "303b47d3-27e1-4bbe-b73b-f0283b3cfd07", "bridge": "br-int", "label": "tempest-device-tagging-net2-1008020813", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1461ee-52", "ovs_interfaceid": "ef1461ee-5288-4255-be42-001889dccbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Detach interface failed, port_id=6983ee02-7d34-4cff-a7be-8aaf2352b907, reason: Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-deleted-ef1461ee-5288-4255-be42-001889dccbd5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:29 user nova-compute[70994]: INFO nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Neutron deleted interface ef1461ee-5288-4255-be42-001889dccbd5; detaching it from the instance and deleting it from the info cache
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16c11948-6864-466d-ac7e-b7d87c0057aa", "address": "fa:16:3e:36:be:2c", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c11948-68", "ovs_interfaceid": "16c11948-6864-466d-ac7e-b7d87c0057aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Detach interface failed, port_id=ef1461ee-5288-4255-be42-001889dccbd5, reason: Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-deleted-16c11948-6864-466d-ac7e-b7d87c0057aa {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:29 user nova-compute[70994]: INFO nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Neutron deleted interface 16c11948-6864-466d-ac7e-b7d87c0057aa; detaching it from the instance and deleting it from the info cache
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [{"id": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "address": "fa:16:3e:01:75:3b", "network": {"id": "57074e77-8214-4b21-a301-f1c1e594b49a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1971317815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b14d748-e7", "ovs_interfaceid": "8b14d748-e776-4d6f-87d7-64d82f9fd27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "address": "fa:16:3e:70:09:d6", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657dedfb-d8", "ovs_interfaceid": "657dedfb-d8e8-4675-856c-dc0bbd13a2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "address": "fa:16:3e:d5:bc:04", "network": {"id": "6dfa1d49-0df7-4168-a7d1-301f43a4ad45", "bridge": "br-int", "label": "tempest-device-tagging-net1-266266784", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b0a7eb226524d17aa02c7f0d35be501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48fc0163-4e", "ovs_interfaceid": "48fc0163-4e5a-4ffc-915e-25f8482d78a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-08710f7c-c685-4111-8586-1de7809302ab req-55633799-91da-4b5d-8044-3ef54dd721e9 service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Detach interface failed, port_id=16c11948-6864-466d-ac7e-b7d87c0057aa, reason: Instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:30 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Took 4.57 seconds to deallocate network for instance.
Jul 27 12:42:30 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Took 4.23 seconds to deallocate network for instance.
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-9996674a-6fd3-418c-b650-93d8d8f3fca4 req-4e4fe634-544c-404b-aac4-9da74e84743d service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-deleted-3b3e3584-994e-440b-81b3-1d6a5fc98923 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-9996674a-6fd3-418c-b650-93d8d8f3fca4 req-4e4fe634-544c-404b-aac4-9da74e84743d service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-deleted-92b87fcb-1b9b-45d7-bcd9-b71f78b22b49 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-9996674a-6fd3-418c-b650-93d8d8f3fca4 req-4e4fe634-544c-404b-aac4-9da74e84743d service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-deleted-bc495d56-5cc3-4e23-b0c8-7a18b582df31 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-9996674a-6fd3-418c-b650-93d8d8f3fca4 req-4e4fe634-544c-404b-aac4-9da74e84743d service nova] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Received event network-vif-deleted-f8924976-f987-42b4-a080-b635ce4fefc3 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-c3c67f83-46f4-464d-912b-65d84049df8e req-055ff90a-5945-47a8-ba18-9a4cd6ec6b9d service nova] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Received event network-vif-deleted-8b14d748-e776-4d6f-87d7-64d82f9fd27a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: INFO nova.compute.manager [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Took 2.41 seconds to detach 3 volumes for instance.
Jul 27 12:42:32 user nova-compute[70994]: INFO nova.compute.manager [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Took 2.42 seconds to detach 3 volumes for instance.
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.458s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:33 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Deleted allocations for instance b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0778856e-5516-467b-93a3-7368ea263d44 tempest-TaggedBootDevicesTest-1690118915 tempest-TaggedBootDevicesTest-1690118915-project-member] Lock "b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.346s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:34 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Deleted allocations for instance c7fb777c-fae8-438d-a339-478ed2f8cb49
Jul 27 12:42:34 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:42:34 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=25.647232055664062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f0227c8e-644e-43f5-a8b6-43dfe67fa61c tempest-TaggedBootDevicesTest_v242-409814752 tempest-TaggedBootDevicesTest_v242-409814752-project-member] Lock "c7fb777c-fae8-438d-a339-478ed2f8cb49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.409s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 662c50c8-4f10-4cc1-b537-cf31dde13cca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 6cf552b3-722e-49fd-b915-bed44ba8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2cb0bf10-69e2-4494-9b67-d53d48e83446 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:42:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:36 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461741.7889695, b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:42:36 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] VM Stopped (Lifecycle Event)
Jul 27 12:42:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f5df4776-2821-4ec9-9ae6-1dea4b6303ba None None] [instance: b2345e4b-1dc1-4cd8-8ed1-3bf70917bf6c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:42:38 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:42:38 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461743.7932222, c7fb777c-fae8-438d-a339-478ed2f8cb49 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:42:38 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] VM Stopped (Lifecycle Event)
Jul 27 12:42:38 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fdc7a0d2-da02-4e98-b82b-a64afc70a913 None None] [instance: c7fb777c-fae8-438d-a339-478ed2f8cb49] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:42:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:42:43 user nova-compute[70994]: INFO nova.compute.claims [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Claim successful on node user
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:42:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.policy [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bab6b6a50d274fdeb10da465b2b89eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371ee6c1bd154750aa942c3b582d2bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:42:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Creating image(s)
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "/opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "/opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "/opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.129s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.128s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk 1073741824" returned: 0 in 0.046s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Successfully created port: 5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Cannot resize image /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'migration_context' on Instance uuid f551a826-789e-4bd2-a6d7-81f3b743a31b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Ensure instance console log exists: /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Successfully updated port: 5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquired lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-changed-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Refreshing instance network info cache due to event network-changed-5f7e5bd7-c423-4343-80f1-89ad0915e801. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] Acquiring lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Updating instance_info_cache with network_info: [{"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Releasing lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Instance network_info: |[{"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] Acquired lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Refreshing network info cache for port 5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Start _get_guest_xml network_info=[{"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:42:45 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:42:45 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746112795',display_name='tempest-VolumesAdminNegativeTest-server-1746112795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746112795',id=16,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-qkyuozhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:42:44Z,user_data=None,user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=f551a826-789e-4bd2-a6d7-81f3b743a31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'pci_devices' on Instance uuid f551a826-789e-4bd2-a6d7-81f3b743a31b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:42:45 user nova-compute[70994]:   <uuid>f551a826-789e-4bd2-a6d7-81f3b743a31b</uuid>
Jul 27 12:42:45 user nova-compute[70994]:   <name>instance-00000010</name>
Jul 27 12:42:45 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:42:45 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:42:45 user nova-compute[70994]:   <metadata>
Jul 27 12:42:45 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:42:45 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1746112795</nova:name>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:42:45</nova:creationTime>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:42:45 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:42:45 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:owner>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:user uuid="bab6b6a50d274fdeb10da465b2b89eb9">tempest-VolumesAdminNegativeTest-1117550447-project-member</nova:user>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:project uuid="371ee6c1bd154750aa942c3b582d2bda">tempest-VolumesAdminNegativeTest-1117550447</nova:project>
Jul 27 12:42:45 user nova-compute[70994]:       </nova:owner>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:42:45 user nova-compute[70994]:       <nova:ports>
Jul 27 12:42:45 user nova-compute[70994]:         <nova:port uuid="5f7e5bd7-c423-4343-80f1-89ad0915e801">
Jul 27 12:42:45 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 12:42:45 user nova-compute[70994]:         </nova:port>
Jul 27 12:42:45 user nova-compute[70994]:       </nova:ports>
Jul 27 12:42:45 user nova-compute[70994]:     </nova:instance>
Jul 27 12:42:45 user nova-compute[70994]:   </metadata>
Jul 27 12:42:45 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:42:45 user nova-compute[70994]:     <system>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="serial">f551a826-789e-4bd2-a6d7-81f3b743a31b</entry>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="uuid">f551a826-789e-4bd2-a6d7-81f3b743a31b</entry>
Jul 27 12:42:45 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:42:45 user nova-compute[70994]:     </system>
Jul 27 12:42:45 user nova-compute[70994]:   </sysinfo>
Jul 27 12:42:45 user nova-compute[70994]:   <os>
Jul 27 12:42:45 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:42:45 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:42:45 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:42:45 user nova-compute[70994]:   </os>
Jul 27 12:42:45 user nova-compute[70994]:   <features>
Jul 27 12:42:45 user nova-compute[70994]:     <acpi/>
Jul 27 12:42:45 user nova-compute[70994]:     <apic/>
Jul 27 12:42:45 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:42:45 user nova-compute[70994]:   </features>
Jul 27 12:42:45 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:42:45 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:42:45 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:42:45 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:42:45 user nova-compute[70994]:   </clock>
Jul 27 12:42:45 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:42:45 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:42:45 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:42:45 user nova-compute[70994]:   </cpu>
Jul 27 12:42:45 user nova-compute[70994]:   <devices>
Jul 27 12:42:45 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:42:45 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:42:45 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk"/>
Jul 27 12:42:45 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:42:45 user nova-compute[70994]:     </disk>
Jul 27 12:42:45 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:42:45 user nova-compute[70994]:       <mac address="fa:16:3e:53:70:8c"/>
Jul 27 12:42:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:42:45 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:42:45 user nova-compute[70994]:       <target dev="tap5f7e5bd7-c4"/>
Jul 27 12:42:45 user nova-compute[70994]:     </interface>
Jul 27 12:42:45 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:42:45 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/console.log" append="off"/>
Jul 27 12:42:45 user nova-compute[70994]:     </serial>
Jul 27 12:42:45 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:42:45 user nova-compute[70994]:     <video>
Jul 27 12:42:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:42:45 user nova-compute[70994]:     </video>
Jul 27 12:42:45 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:42:45 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:42:45 user nova-compute[70994]:     </rng>
Jul 27 12:42:45 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:42:45 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:42:45 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:42:45 user nova-compute[70994]:     </memballoon>
Jul 27 12:42:45 user nova-compute[70994]:   </devices>
Jul 27 12:42:45 user nova-compute[70994]: </domain>
Jul 27 12:42:45 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746112795',display_name='tempest-VolumesAdminNegativeTest-server-1746112795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746112795',id=16,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-qkyuozhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:42:44Z,user_data=None,user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=f551a826-789e-4bd2-a6d7-81f3b743a31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG os_vif [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f7e5bd7-c4, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f7e5bd7-c4, col_values=(('external_ids', {'iface-id': '5f7e5bd7-c423-4343-80f1-89ad0915e801', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:70:8c', 'vm-uuid': 'f551a826-789e-4bd2-a6d7-81f3b743a31b'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:45 user nova-compute[70994]: INFO os_vif [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4')
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:42:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] No VIF found with MAC fa:16:3e:53:70:8c, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:42:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Updated VIF entry in instance network info cache for port 5f7e5bd7-c423-4343-80f1-89ad0915e801. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:42:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Updating instance_info_cache with network_info: [{"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-59eb99bf-8b74-4a09-a6e8-fbc1c87ba8b4 req-febf3ba9-2b58-4ee7-b1f3-eea87d1459d8 service nova] Releasing lock "refresh_cache-f551a826-789e-4bd2-a6d7-81f3b743a31b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] No waiting events found dispatching network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:47 user nova-compute[70994]: WARNING nova.compute.manager [req-8a55efc3-a6cd-4434-9925-a484e3863355 req-51bea5ec-7cb3-4fa4-b7d5-a8f90fb8c1d3 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received unexpected event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 for instance with vm_state building and task_state spawning.
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461769.1913528, f551a826-789e-4bd2-a6d7-81f3b743a31b => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] VM Resumed (Lifecycle Event)
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Instance spawned successfully.
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461769.1945717, f551a826-789e-4bd2-a6d7-81f3b743a31b => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] VM Started (Lifecycle Event)
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Took 5.59 seconds to spawn the instance on the hypervisor.
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Took 6.35 seconds to build instance.
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] No waiting events found dispatching network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:49 user nova-compute[70994]: WARNING nova.compute.manager [req-c366f6e1-243d-4c94-bcd0-ad9acbf2d6f9 req-78fc1294-16f8-4beb-91e6-9d1ff1a4fae9 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received unexpected event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 for instance with vm_state active and task_state None.
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f91489c8-c860-433e-a8ef-25a71a4e77b5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.451s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:49 user nova-compute[70994]: INFO nova.compute.manager [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Terminating instance
Jul 27 12:42:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Instance destroyed successfully.
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.objects.instance [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'resources' on Instance uuid 6cf552b3-722e-49fd-b915-bed44ba8ab84 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:40:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1313136011',display_name='tempest-ServersNegativeTestJSON-server-1313136011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1313136011',id=14,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-yxsbxrk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:10Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=6cf552b3-722e-49fd-b915-bed44ba8ab84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "21290824-2cf3-45a7-a124-2a4bb4240652", "address": "fa:16:3e:de:9f:58", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21290824-2c", "ovs_interfaceid": "21290824-2cf3-45a7-a124-2a4bb4240652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG os_vif [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21290824-2c, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:50 user nova-compute[70994]: INFO os_vif [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:9f:58,bridge_name='br-int',has_traffic_filtering=True,id=21290824-2cf3-45a7-a124-2a4bb4240652,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21290824-2c')
Jul 27 12:42:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Deleting instance files /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84_del
Jul 27 12:42:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Deletion of /opt/stack/data/nova/instances/6cf552b3-722e-49fd-b915-bed44ba8ab84_del complete
Jul 27 12:42:50 user nova-compute[70994]: INFO nova.compute.manager [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 12:42:50 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:42:50 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:42:51 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Took 0.56 seconds to deallocate network for instance.
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-bde56d7e-1ae6-4760-81c8-894c8f832528 req-099dca6d-dfa8-478e-9d54-c4f9fd5ca232 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-vif-deleted-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-vif-unplugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] No waiting events found dispatching network-vif-unplugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:51 user nova-compute[70994]: WARNING nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received unexpected event network-vif-unplugged-21290824-2cf3-45a7-a124-2a4bb4240652 for instance with vm_state deleted and task_state None.
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Acquiring lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] No waiting events found dispatching network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:42:51 user nova-compute[70994]: WARNING nova.compute.manager [req-45cefc07-1d45-4664-b826-b17bac5a57b3 req-21960720-56c2-42d0-b9ec-8d12f78bb661 service nova] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Received unexpected event network-vif-plugged-21290824-2cf3-45a7-a124-2a4bb4240652 for instance with vm_state deleted and task_state None.
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:42:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.670s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:51 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Deleted allocations for instance 6cf552b3-722e-49fd-b915-bed44ba8ab84
Jul 27 12:42:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-957f9d5b-7c6d-48c0-a263-aeab54238fc6 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "6cf552b3-722e-49fd-b915-bed44ba8ab84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.430s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:42:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:42:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461770.4502583, 6cf552b3-722e-49fd-b915-bed44ba8ab84 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:05 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] VM Stopped (Lifecycle Event)
Jul 27 12:43:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bfb19a8f-ef38-4063-b44e-6037e81fec6f None None] [instance: 6cf552b3-722e-49fd-b915-bed44ba8ab84] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:05 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:43:05 user nova-compute[70994]: INFO nova.compute.claims [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Claim successful on node user
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:43:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:43:06 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:43:06 user nova-compute[70994]: INFO nova.virt.block_device [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Booting with blank volume at /dev/vda
Jul 27 12:43:06 user nova-compute[70994]: DEBUG nova.policy [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '593a7d28021a47b491c7fa86af3edc80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cd4ff8af2445179cc6ba07c251dd4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:43:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:07 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Successfully created port: 559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:43:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:07 user nova-compute[70994]: INFO nova.compute.manager [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Unshelving
Jul 27 12:43:07 user nova-compute[70994]: INFO nova.virt.block_device [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Booting with volume 5076fce9-1edf-45c9-b54a-a800ab798fd6 at /dev/vdc
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e01b9-6ac6-4368-a491-6525163ea64d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f915e2-4341-4850-99fa-4fe422173b3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385f57d-8879-4510-8551-5f2b15de3f48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3643d-5250-48ac-aace-e4d8356d2771]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:08 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed140a0-52c0-4bae-9e9a-792df8075d07]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating existing volume attachment record: f4660d49-6735-4505-b2c3-3f5467df5138 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Successfully updated port: 559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-changed-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Refreshing instance network info cache due to event network-changed-559742f0-5d2f-414b-9963-35b75a83c42f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance network_info: |[{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Refreshing network info cache for port 559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG nova.objects.instance [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'flavor' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:09 user nova-compute[70994]: INFO nova.compute.manager [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attaching volume d8a4e71e-262b-499d-860a-c8d26b41c214 to /dev/vdb
Jul 27 12:43:09 user nova-compute[70994]: DEBUG nova.network.neutron [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updated VIF entry in instance network info cache for port 559742f0-5d2f-414b-9963-35b75a83c42f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG nova.network.neutron [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83cc0a66-00e3-46e5-bc38-2d239890ff1d req-2ec30a28-7255-4dfa-9848-e079e7c0e393 service nova] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.utils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018f95d-aa6a-4d40-858f-73dfb5a7bf7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b025c4-6685-4a7a-94e3-16bcf2ef1222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb3287b-d30d-4989-9828-dd2efc28963c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bd551-088d-4ce0-a31e-b5f0c30d6270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:09 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:43:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20b3ca-9e57-4e30-9e86-117433671cb7]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG os_brick.utils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:09 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating existing volume attachment record: 2dc3b57d-d419-43a8-9d8d-aa07087e1560 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:43:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:11 user nova-compute[70994]: INFO nova.compute.manager [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Terminating instance
Jul 27 12:43:11 user nova-compute[70994]: DEBUG nova.compute.manager [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.utils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e14c78-1668-49e7-ae76-81226245605d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5912815-9cf7-4f34-860b-de75c32b7352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7dcd36-d956-48b0-9c6f-5878e12e0bb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d6f92-592d-4651-b096-65cbd9ff3ea9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:12 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de22e65-8218-495c-a4bf-da05e2e51199]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_brick.utils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating existing volume attachment record: 914719db-14aa-48fa-a73c-ff94b90e04e0 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Instance destroyed successfully.
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lazy-loading 'resources' on Instance uuid 662c50c8-4f10-4cc1-b537-cf31dde13cca {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1342825356',display_name='tempest-TestVolumeSwap-server-1342825356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1342825356',id=9,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwMyZ48fAb/YsJf4stRDUGvVJpgfOdfnfCcoqFvj37eSL0KTIn3Zkfez0Oxe3ki0xGzMAhXp15fsbikbv+waTy7+dRazIlAr6yUlNMXBGVTPb7nroi34WlcM6gHGPUbPw==',key_name='tempest-keypair-1524537095',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e44f7ad000945eab5a0030d38ca9dfe',ramdisk_id='',reservation_id='r-did3q75s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1830146653',owner_user_name='tempest-TestVolumeSwap-1830146653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82176d7d1cc74f33bb116d5f872ce53a',uuid=662c50c8-4f10-4cc1-b537-cf31dde13cca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converting VIF {"id": "21ff2b01-1000-4d58-b089-15568956e6ab", "address": "fa:16:3e:32:92:7a", "network": {"id": "9ed5772b-20cb-4a67-b502-ed108f8d6c19", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1836826142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e44f7ad000945eab5a0030d38ca9dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ff2b01-10", "ovs_interfaceid": "21ff2b01-1000-4d58-b089-15568956e6ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG os_vif [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ff2b01-10, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:12 user nova-compute[70994]: INFO os_vif [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:92:7a,bridge_name='br-int',has_traffic_filtering=True,id=21ff2b01-1000-4d58-b089-15568956e6ab,network=Network(9ed5772b-20cb-4a67-b502-ed108f8d6c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ff2b01-10')
Jul 27 12:43:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Deleting instance files /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca_del
Jul 27 12:43:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Deletion of /opt/stack/data/nova/instances/662c50c8-4f10-4cc1-b537-cf31dde13cca_del complete
Jul 27 12:43:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-unplugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] No waiting events found dispatching network-vif-unplugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-a0759c29-96f8-4fc4-ad80-7803ec14751b req-32d6fe8b-d386-4af0-a202-c9698fc6bb49 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-unplugged-21ff2b01-1000-4d58-b089-15568956e6ab for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:43:13 user nova-compute[70994]: INFO nova.compute.manager [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 27 12:43:13 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:43:13 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:43:13 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] Acquiring lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] No waiting events found dispatching network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:15 user nova-compute[70994]: WARNING nova.compute.manager [req-958a32a6-7284-4c39-aa99-adb2a647ccc8 req-2d343db2-fb98-450a-abf4-0110b860cfe3 service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received unexpected event network-vif-plugged-21ff2b01-1000-4d58-b089-15568956e6ab for instance with vm_state active and task_state deleting.
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-changed-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Refreshing instance network info cache due to event network-changed-4f2b0d75-4dee-4bee-8d18-871bf5922540. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] Acquiring lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] Acquired lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Refreshing network info cache for port 4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc3658ec-ad9b-4e87-a559-a9b3ddcdee46 req-246488d8-2d6f-46d7-8adf-b931b03e069d service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Received event network-vif-deleted-21ff2b01-1000-4d58-b089-15568956e6ab {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:15 user nova-compute[70994]: INFO nova.compute.manager [req-fc3658ec-ad9b-4e87-a559-a9b3ddcdee46 req-246488d8-2d6f-46d7-8adf-b931b03e069d service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Neutron deleted interface 21ff2b01-1000-4d58-b089-15568956e6ab; detaching it from the instance and deleting it from the info cache
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc3658ec-ad9b-4e87-a559-a9b3ddcdee46 req-246488d8-2d6f-46d7-8adf-b931b03e069d service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:15 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Took 2.44 seconds to deallocate network for instance.
Jul 27 12:43:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc3658ec-ad9b-4e87-a559-a9b3ddcdee46 req-246488d8-2d6f-46d7-8adf-b931b03e069d service nova] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Detach interface failed, port_id=21ff2b01-1000-4d58-b089-15568956e6ab, reason: Instance 662c50c8-4f10-4cc1-b537-cf31dde13cca could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:16 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Deleted allocations for instance 662c50c8-4f10-4cc1-b537-cf31dde13cca
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updated VIF entry in instance network info cache for port 4f2b0d75-4dee-4bee-8d18-871bf5922540. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating instance_info_cache with network_info: [{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cdcc40ef-76eb-4581-bd07-e77b7f138643 tempest-TestVolumeSwap-1830146653 tempest-TestVolumeSwap-1830146653-project-member] Lock "662c50c8-4f10-4cc1-b537-cf31dde13cca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.482s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e76cfde-e30e-47e2-a2f0-029a3b337ff9 req-8a005ce5-7b3b-4861-8318-f4f7133b6bdf service nova] Releasing lock "refresh_cache-2cb0bf10-69e2-4494-9b67-d53d48e83446" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_requests' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:16 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:43:16 user nova-compute[70994]: INFO nova.compute.claims [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Claim successful on node user
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:17 user nova-compute[70994]: INFO nova.network.neutron [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 12:43:17 user nova-compute[70994]: INFO nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Rebuilding instance
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'pci_requests' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'resources' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'migration_context' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:18 user nova-compute[70994]: WARNING nova.compute.manager [req-efc0e1e5-fc34-4ae5-8ba4-b7a9c1f0a812 req-d8acc33e-b408-4452-b2fe-c145753d8dd4 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:18 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf92e4-ec06-48da-87a4-f40c148241d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:43:18 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294a0ad-8909-4a65-91cb-46673c038a83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214] added
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238759a-4df2-4d52-bd45-a1c36aafccf3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d32bb7-3fff-48e8-a4c1-b5993cfdc7d6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzLEZBAv {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzLEZBAv" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f6e93a-6222-4882-90fe-c2e38d1d43b6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzLEZBAv'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b0d482-77db-451a-b8e9-1b6e36b56bd9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdf990-c1e3-49ed-8ae4-c0eee4760273]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f4847-9846-45fa-b0db-131cf8da0454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]
Jul 27 12:43:18 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c815db1-fd7b-4b48-be60-b7996cecaea6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3929ae8-8981-477d-a6ca-eed1877037bf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9424ae-b2bf-456e-91cf-655a39a8d265]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:18 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance destroyed successfully.
Jul 27 12:43:18 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance destroyed successfully.
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-730231908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG os_vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f2b0d75-4d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:19 user nova-compute[70994]: INFO os_vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d')
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:19 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26438653534333036', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438653534333036', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.891s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing instance network info cache due to event network-changed-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'flavor' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462a72b-9ee0-42e3-94ff-7e6db3ebbe8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:43:19 user nova-compute[70994]: No targets found.
Jul 27 12:43:19 user nova-compute[70994]: iSNS:
Jul 27 12:43:19 user nova-compute[70994]: No targets found.
Jul 27 12:43:19 user nova-compute[70994]: STATIC:
Jul 27 12:43:19 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:43:19 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:19 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:19 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:43:19 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:19 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:19 user nova-compute[70994]: FIRMWARE:
Jul 27 12:43:19 user nova-compute[70994]: No targets found.
Jul 27 12:43:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:43:19 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:43:19 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:43:19 user nova-compute[70994]: INFO nova.compute.claims [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Claim successful on node user
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[30910fb8-aabe-4134-8cf4-83a8d79332b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:43:19 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:19 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:43:19 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:43:19 user nova-compute[70994]:   <serial>d8a4e71e-262b-499d-860a-c8d26b41c214</serial>
Jul 27 12:43:19 user nova-compute[70994]: </disk>
Jul 27 12:43:19 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506ce3b-afc8-4c2a-9b34-852e4e0ec377]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:19 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:19 user nova-compute[70994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc725e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29'): ({'sdh'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Removing single pathed devices sdh {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:43:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0997c3c-8fc8-4811-be1c-de63f2019b52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[be528a11-1cc5-4509-a9cb-d0fd3acc5308]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flushing IO for device /dev/sdh {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfafce2-1468-4e7e-9adf-4ca21c3f2203]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f24eb1d-4e8c-41be-8d1e-4b24a722912b]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83f302-e88a-4e46-8248-96fa20df0a56]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5963aa86-0af6-44f5-936c-d335861405ed]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]
Jul 27 12:43:20 user nova-compute[70994]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:20 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0d7d5-cbd0-42a9-b148-254f630e7ab1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== disconnect_volume: return (1258ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:43:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deleting instance files /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446_del
Jul 27 12:43:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deletion of /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446_del complete
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.compute.manager [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:20 user nova-compute[70994]: WARNING nova.compute.manager [req-480fbb18-0b90-4573-98a9-e2609f6efb5d req-1aee00bc-b9c9-41ed-b8a9-ae204c98de5f service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No VIF found with MAC fa:16:3e:23:46:4b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:43:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Creating image(s)
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.network.neutron [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Refreshing network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "f6702595f0204c65044c14921f7c1c520a300d8f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "f6702595f0204c65044c14921f7c1c520a300d8f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:43:20 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2cb0bf10-69e2-4494-9b67-d53d48e83446 could not be found.
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:20 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec558b-2081-42e8-ab1a-4187cffaefe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:43:20 user nova-compute[70994]: No targets found.
Jul 27 12:43:20 user nova-compute[70994]: iSNS:
Jul 27 12:43:20 user nova-compute[70994]: No targets found.
Jul 27 12:43:20 user nova-compute[70994]: STATIC:
Jul 27 12:43:20 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:43:20 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:20 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:20 user nova-compute[70994]: FIRMWARE:
Jul 27 12:43:20 user nova-compute[70994]: No targets found.
Jul 27 12:43:20 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:43:20 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:43:20 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b28f93-8002-431e-9997-57438669567e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:20 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-47ab7d17-0675-44bc-a93d-91c3ba5a5785 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.057s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744fd69-2e93-4a7f-8c66-d91a87742f1d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.policy [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '300a2b66d5aa4551ba7a35107feb15f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df70a3a511c2416994b9b5864f29a387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:43:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Creating image(s)
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Ensure instance console log exists: /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start _get_guest_xml network_info=[{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa5113ca-9965-4138-af35-af69b50f9500', 'attached_at': '', 'detached_at': '', 'volume_id': '0ee3171b-e8ff-47d2-8f38-01742340240c', 'serial': '0ee3171b-e8ff-47d2-8f38-01742340240c'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '914719db-14aa-48fa-a73c-ff94b90e04e0', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:21 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc404160>, {}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Disconnecting from: [] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.175s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== disconnect_volume: return (1176ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:43:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:21 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:21 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:21 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.part --force-share --output=json" returned: 0 in 0.195s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.images [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] 0207b707-fe48-4158-bca9-b172e0a394a3 was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.part /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826d41f-c322-4491-8c82-61355ffbb037]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:43:21 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:43:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Creating image(s)
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8106fcfb-55dc-44dd-b83f-706785c242fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c] added
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bbdcb8-397a-44f5-86f2-3fc9e650c2be]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.169s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d08b5e-fd2d-4968-ad22-60f69e0c19e3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.247s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtKAPNDj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtKAPNDj" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fb2500-9072-4052-abbc-0d4c7791abc1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtKAPNDj'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae2b9a-ce29-4b1e-8582-b5f4fe420e7a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bb7213-8a08-4c16-addc-62cb21ddbed1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.part /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.converted" returned: 0 in 0.540s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6590282-d568-4a59-a3eb-bf9ed9ac7d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260]
Jul 27 12:43:22 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk 1073741824" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0037e52-d0b6-4d0a-a91d-b8693c118cad]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da81ff08-bb7c-4685-924a-381bdc6e5796]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:22 user nova-compute[70994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:22 user nova-compute[70994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.783s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "f6702595f0204c65044c14921f7c1c520a300d8f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.118s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd63a24f-8a5a-4c3d-8e06-909340b18242]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.193s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updated VIF entry in instance network info cache for port 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6965fa00-7374-427e-b1a3-d0fdbc352b4a req-c351b9b6-6a38-44bf-ae74-605b14e1e950 service nova] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:22 user nova-compute[70994]: INFO nova.compute.manager [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Rebuilding instance
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json" returned: 0 in 0.202s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "f6702595f0204c65044c14921f7c1c520a300d8f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "f6702595f0204c65044c14921f7c1c520a300d8f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Cannot resize image /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.objects.instance [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'migration_context' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Ensure instance console log exists: /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:22 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Preparing to wait for external event volume-reimaged-f32b4fcf-7494-414d-ba47-46f6a1e03f29 {{(pid=70994) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json" returned: 0 in 0.155s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f,backing_fmt=raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Successfully created port: 3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f,backing_fmt=raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk 1073741824" returned: 0 in 0.066s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "f6702595f0204c65044c14921f7c1c520a300d8f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_requests' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6702595f0204c65044c14921f7c1c520a300d8f --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'migration_context' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'resources' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Rebasing disk image.
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'migration_context' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 -F raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:23 user nova-compute[70994]: WARNING nova.compute.manager [req-7bc1f10c-839f-4899-8523-3abe0be8ca9e req-c8fb8961-b8d7-48a3-8787-a1f148f691b0 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.872s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== connect_volume: return (1874ms) {'type': 'block', 'scsi_wwn': '23735393165316263', 'path': '/dev/sdc'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735393165316263', 'path': '/dev/sdc'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262489840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262489840',id=17,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-esrxz47u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:06Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=aa5113ca-9965-4138-af35-af69b50f9500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:23 user nova-compute[70994]:   <uuid>aa5113ca-9965-4138-af35-af69b50f9500</uuid>
Jul 27 12:43:23 user nova-compute[70994]:   <name>instance-00000011</name>
Jul 27 12:43:23 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:23 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:23 user nova-compute[70994]:   <metadata>
Jul 27 12:43:23 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:23 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1262489840</nova:name>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:21</nova:creationTime>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:23 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:23 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:43:23 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:43:23 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:23 user nova-compute[70994]:         <nova:port uuid="559742f0-5d2f-414b-9963-35b75a83c42f">
Jul 27 12:43:23 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:43:23 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:23 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:23 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:23 user nova-compute[70994]:   </metadata>
Jul 27 12:43:23 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:23 user nova-compute[70994]:     <system>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="serial">aa5113ca-9965-4138-af35-af69b50f9500</entry>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="uuid">aa5113ca-9965-4138-af35-af69b50f9500</entry>
Jul 27 12:43:23 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:23 user nova-compute[70994]:     </system>
Jul 27 12:43:23 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:23 user nova-compute[70994]:   <os>
Jul 27 12:43:23 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:23 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:43:23 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:23 user nova-compute[70994]:   </os>
Jul 27 12:43:23 user nova-compute[70994]:   <features>
Jul 27 12:43:23 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:23 user nova-compute[70994]:     <apic/>
Jul 27 12:43:23 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:23 user nova-compute[70994]:   </features>
Jul 27 12:43:23 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:23 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:23 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:23 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:23 user nova-compute[70994]:   </clock>
Jul 27 12:43:23 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:23 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:23 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:23 user nova-compute[70994]:   </cpu>
Jul 27 12:43:23 user nova-compute[70994]:   <devices>
Jul 27 12:43:23 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:43:23 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:23 user nova-compute[70994]:       <source dev="/dev/sdc"/>
Jul 27 12:43:23 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:23 user nova-compute[70994]:       <serial>0ee3171b-e8ff-47d2-8f38-01742340240c</serial>
Jul 27 12:43:23 user nova-compute[70994]:     </disk>
Jul 27 12:43:23 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:23 user nova-compute[70994]:       <mac address="fa:16:3e:87:82:18"/>
Jul 27 12:43:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:23 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:23 user nova-compute[70994]:       <target dev="tap559742f0-5d"/>
Jul 27 12:43:23 user nova-compute[70994]:     </interface>
Jul 27 12:43:23 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:23 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/console.log" append="off"/>
Jul 27 12:43:23 user nova-compute[70994]:     </serial>
Jul 27 12:43:23 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:23 user nova-compute[70994]:     <video>
Jul 27 12:43:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:23 user nova-compute[70994]:     </video>
Jul 27 12:43:23 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:23 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:23 user nova-compute[70994]:     </rng>
Jul 27 12:43:23 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:23 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:23 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:23 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:23 user nova-compute[70994]:   </devices>
Jul 27 12:43:23 user nova-compute[70994]: </domain>
Jul 27 12:43:23 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262489840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262489840',id=17,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-esrxz47u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:06Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=aa5113ca-9965-4138-af35-af69b50f9500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG os_vif [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap559742f0-5d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap559742f0-5d, col_values=(('external_ids', {'iface-id': '559742f0-5d2f-414b-9963-35b75a83c42f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:82:18', 'vm-uuid': 'aa5113ca-9965-4138-af35-af69b50f9500'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:23 user nova-compute[70994]: INFO os_vif [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d')
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:87:82:18, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance destroyed successfully.
Jul 27 12:43:24 user nova-compute[70994]: INFO nova.compute.manager [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Detaching volume d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Successfully updated port: 3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:43:24 user nova-compute[70994]: INFO nova.virt.block_device [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attempting to driver detach volume d8a4e71e-262b-499d-860a-c8d26b41c214 from mountpoint /dev/vdb
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Attempting to detach device vdb from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:43:24 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:24 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:43:24 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:43:24 user nova-compute[70994]:   <serial>d8a4e71e-262b-499d-860a-c8d26b41c214</serial>
Jul 27 12:43:24 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:43:24 user nova-compute[70994]: </disk>
Jul 27 12:43:24 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-changed-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Refreshing instance network info cache due to event network-changed-3418446e-e2a1-4516-a37e-be94d79fbf4f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully detached device vdb from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the persistent domain config.
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:24 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37645ecf-4ddb-4cc2-906e-20e699374508]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:43:24 user nova-compute[70994]: No targets found.
Jul 27 12:43:24 user nova-compute[70994]: iSNS:
Jul 27 12:43:24 user nova-compute[70994]: No targets found.
Jul 27 12:43:24 user nova-compute[70994]: STATIC:
Jul 27 12:43:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:43:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:24 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:43:24 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:24 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:24 user nova-compute[70994]: FIRMWARE:
Jul 27 12:43:24 user nova-compute[70994]: No targets found.
Jul 27 12:43:24 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:43:24 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:43:24 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d6d75-5e9c-4d2f-b677-79a1c4b197e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60c5741-e6b2-4e72-b093-86668d50eb7f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:25 user nova-compute[70994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:25 user nova-compute[70994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc5ab6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad260d-e93b-4a76-b161-3d8b4bd1dbf7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54fb7b-77db-493a-8c1d-d2a7e108691c]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b466c034-6a9b-4651-bc79-de595b24fdb2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b20db4-13b8-4c9c-a3b2-5beea4e480d8]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.099s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e06eff8-8a4f-4ac7-8634-a8657dad66a5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ddf67b-5431-496f-b8cd-cad34f3fb12a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]
Jul 27 12:43:25 user nova-compute[70994]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.neutron [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a9723-d6ca-42d3-96cb-ad58e50585e0]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== disconnect_volume: return (458ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance network_info: |[{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Refreshing network info cache for port 3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start _get_guest_xml network_info=[{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'pci_devices' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:25 user nova-compute[70994]:   <uuid>f57d289e-51df-412e-89ef-2698eef4453c</uuid>
Jul 27 12:43:25 user nova-compute[70994]:   <name>instance-00000012</name>
Jul 27 12:43:25 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:25 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:25 user nova-compute[70994]:   <metadata>
Jul 27 12:43:25 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:25 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherB-server-1698964685</nova:name>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:25</nova:creationTime>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:25 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:25 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:user uuid="300a2b66d5aa4551ba7a35107feb15f0">tempest-ServerActionsTestOtherB-413140038-project-member</nova:user>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:project uuid="df70a3a511c2416994b9b5864f29a387">tempest-ServerActionsTestOtherB-413140038</nova:project>
Jul 27 12:43:25 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:43:25 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:25 user nova-compute[70994]:         <nova:port uuid="3418446e-e2a1-4516-a37e-be94d79fbf4f">
Jul 27 12:43:25 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:43:25 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:25 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:25 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:25 user nova-compute[70994]:   </metadata>
Jul 27 12:43:25 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:25 user nova-compute[70994]:     <system>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="serial">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="uuid">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:43:25 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:25 user nova-compute[70994]:     </system>
Jul 27 12:43:25 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:25 user nova-compute[70994]:   <os>
Jul 27 12:43:25 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:25 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:43:25 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:25 user nova-compute[70994]:   </os>
Jul 27 12:43:25 user nova-compute[70994]:   <features>
Jul 27 12:43:25 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:25 user nova-compute[70994]:     <apic/>
Jul 27 12:43:25 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:25 user nova-compute[70994]:   </features>
Jul 27 12:43:25 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:25 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:25 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:25 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:25 user nova-compute[70994]:   </clock>
Jul 27 12:43:25 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:25 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:25 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:25 user nova-compute[70994]:   </cpu>
Jul 27 12:43:25 user nova-compute[70994]:   <devices>
Jul 27 12:43:25 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:43:25 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:43:25 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk"/>
Jul 27 12:43:25 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:25 user nova-compute[70994]:     </disk>
Jul 27 12:43:25 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:25 user nova-compute[70994]:       <mac address="fa:16:3e:6f:65:65"/>
Jul 27 12:43:25 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:25 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:25 user nova-compute[70994]:       <target dev="tap3418446e-e2"/>
Jul 27 12:43:25 user nova-compute[70994]:     </interface>
Jul 27 12:43:25 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:25 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/console.log" append="off"/>
Jul 27 12:43:25 user nova-compute[70994]:     </serial>
Jul 27 12:43:25 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:25 user nova-compute[70994]:     <video>
Jul 27 12:43:25 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:25 user nova-compute[70994]:     </video>
Jul 27 12:43:25 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:25 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:25 user nova-compute[70994]:     </rng>
Jul 27 12:43:25 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:25 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:25 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:25 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:25 user nova-compute[70994]:   </devices>
Jul 27 12:43:25 user nova-compute[70994]: </domain>
Jul 27 12:43:25 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG os_vif [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3418446e-e2, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3418446e-e2, col_values=(('external_ids', {'iface-id': '3418446e-e2a1-4516-a37e-be94d79fbf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:65:65', 'vm-uuid': 'f57d289e-51df-412e-89ef-2698eef4453c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: INFO os_vif [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No VIF found with MAC fa:16:3e:6f:65:65, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:25 user nova-compute[70994]: WARNING nova.compute.manager [req-24437f0b-a827-44fe-aa41-1f3827e9829e req-83d8add1-dea8-4b39-8f77-06aceef3e4d7 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuilding.
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updated VIF entry in instance network info cache for port 3418446e-e2a1-4516-a37e-be94d79fbf4f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:43:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f5c66dd-026e-4ba8-9ba9-f1991a00b7c3 req-1737c81a-136e-4a11-ba2f-65eb2d32cf74 service nova] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:43:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance destroyed successfully.
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1695214911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5389c431-e6, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:43:26 user nova-compute[70994]: INFO os_vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6')
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:26 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d7878e-105c-4bc3-af8c-735324c93dc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:43:26 user nova-compute[70994]: No targets found.
Jul 27 12:43:26 user nova-compute[70994]: iSNS:
Jul 27 12:43:26 user nova-compute[70994]: No targets found.
Jul 27 12:43:26 user nova-compute[70994]: STATIC:
Jul 27 12:43:26 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:43:26 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:43:26 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:43:26 user nova-compute[70994]: FIRMWARE:
Jul 27 12:43:26 user nova-compute[70994]: No targets found.
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:43:26 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:43:26 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[394eee04-9544-4a33-b18f-c452c529421f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 -F raw /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk" returned: 0 in 2.912s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Ensure instance console log exists: /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start _get_guest_xml network_info=[{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='369ed3aae3a7b36dcaff681b01f211c2',container_format='bare',created_at=2023-07-27T12:41:15Z,direct_url=<?>,disk_format='qcow2',id=0207b707-fe48-4158-bca9-b172e0a394a3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1544413435-shelved',owner='0451def811f34a848fd1450763964b49',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T12:41:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhZfiBGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4a853286-11ba-4a34-824b-bc59b8a5ac50', 'attached_at': '', 'detached_at': '', 'volume_id': '5076fce9-1edf-45c9-b54a-a800ab798fd6', 'serial': '5076fce9-1edf-45c9-b54a-a800ab798fd6'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'f4660d49-6735-4505-b2c3-3f5467df5138', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c9f6b-e4ca-4487-87aa-bb3b364ab43b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4300ca0>, {}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Disconnecting from: [] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== disconnect_volume: return (83ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:43:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Deleting instance files /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791_del
Jul 27 12:43:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Deletion of /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791_del complete
Jul 27 12:43:26 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:26 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='369ed3aae3a7b36dcaff681b01f211c2',container_format='bare',created_at=2023-07-27T12:41:15Z,direct_url=<?>,disk_format='qcow2',id=0207b707-fe48-4158-bca9-b172e0a394a3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1544413435-shelved',owner='0451def811f34a848fd1450763964b49',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T12:41:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhZfiBGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:26 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:26 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:26 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[994a2745-b050-4ce9-8bc8-a2e101868505]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:43:26 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35a4927-5ac3-4f2b-8692-4ba15d0777f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6] added
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2cb969-a4fa-4091-8dd8-ec63ce22dd24]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ce522-fe1e-494d-9f75-6ee64385ff53]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HhZfiBGP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: INFO nova.virt.block_device [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Booting with volume d8a4e71e-262b-499d-860a-c8d26b41c214 at /dev/vdb
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HhZfiBGP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad976cb-4d19-4b94-821e-6e38d0f6fdad]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HhZfiBGP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9546c28d-9b82-418b-8f74-e263bbc02c95]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a282494-8543-493e-8db7-b1eb23bebf56]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.utils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75dc35-4c7e-4cb7-a1df-9a19ef2caf0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9aab1-37ed-4972-a51b-e50cca296604]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[21347315-8295-4ee0-a3c0-c9f1405fb912]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260]
Jul 27 12:43:26 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df7baa8-4b56-4d34-983f-014cedf99c6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ea3af-5204-4ca6-95ea-4fc78019f4ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4f0f22-5d4d-45a0-9211-c12c42b5f34c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:26 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd195d-8642-4efb-84ed-b69eba242d12]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.utils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating existing volume attachment record: e3d787eb-0b40-4112-a5ec-cc82bbf5680b {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa6088-7dd2-4cc2-9410-10a95904606f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:26 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:26 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c7dee1-66e8-41df-9ce7-2a7587cba195]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:26 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhZfiBGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461792.6719933, 662c50c8-4f10-4cc1-b537-cf31dde13cca => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:27 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] VM Stopped (Lifecycle Event)
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-82abea4d-c68a-449d-85a1-c042082fb6ce None None] [instance: 662c50c8-4f10-4cc1-b537-cf31dde13cca] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:27 user nova-compute[70994]: WARNING nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state building and task_state spawning.
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:27 user nova-compute[70994]: WARNING nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state building and task_state spawning.
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:27 user nova-compute[70994]: WARNING nova.compute.manager [req-65190899-51da-486d-9d94-d3bf77cf5241 req-efc74133-5a3c-4b22-9dce-2f233198c545 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state building and task_state spawning.
Jul 27 12:43:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26433363935623366', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433363935623366', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='0207b707-fe48-4158-bca9-b172e0a394a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1555823318',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:41:20.086766',shelved_host='user',shelved_image_id='0207b707-fe48-4158-bca9-b172e0a394a3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.objects.instance [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:27 user nova-compute[70994]:   <uuid>4a853286-11ba-4a34-824b-bc59b8a5ac50</uuid>
Jul 27 12:43:27 user nova-compute[70994]:   <name>instance-00000006</name>
Jul 27 12:43:27 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:27 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:27 user nova-compute[70994]:   <metadata>
Jul 27 12:43:27 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:27 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1544413435</nova:name>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:26</nova:creationTime>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:27 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:27 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:user uuid="5a0ba1f1c8b842c4b1067033391456ab">tempest-AttachVolumeShelveTestJSON-1527010192-project-member</nova:user>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:project uuid="0451def811f34a848fd1450763964b49">tempest-AttachVolumeShelveTestJSON-1527010192</nova:project>
Jul 27 12:43:27 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:root type="image" uuid="0207b707-fe48-4158-bca9-b172e0a394a3"/>
Jul 27 12:43:27 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:27 user nova-compute[70994]:         <nova:port uuid="3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f">
Jul 27 12:43:27 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 12:43:27 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:27 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:27 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:27 user nova-compute[70994]:   </metadata>
Jul 27 12:43:27 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:27 user nova-compute[70994]:     <system>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="serial">4a853286-11ba-4a34-824b-bc59b8a5ac50</entry>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="uuid">4a853286-11ba-4a34-824b-bc59b8a5ac50</entry>
Jul 27 12:43:27 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:27 user nova-compute[70994]:     </system>
Jul 27 12:43:27 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:27 user nova-compute[70994]:   <os>
Jul 27 12:43:27 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:27 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:43:27 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:27 user nova-compute[70994]:   </os>
Jul 27 12:43:27 user nova-compute[70994]:   <features>
Jul 27 12:43:27 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:27 user nova-compute[70994]:     <apic/>
Jul 27 12:43:27 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:27 user nova-compute[70994]:   </features>
Jul 27 12:43:27 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:27 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:27 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:27 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:27 user nova-compute[70994]:   </clock>
Jul 27 12:43:27 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:27 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:27 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:27 user nova-compute[70994]:   </cpu>
Jul 27 12:43:27 user nova-compute[70994]:   <devices>
Jul 27 12:43:27 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:43:27 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:43:27 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk"/>
Jul 27 12:43:27 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:27 user nova-compute[70994]:     </disk>
Jul 27 12:43:27 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:43:27 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:27 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:43:27 user nova-compute[70994]:       <target dev="vdc" bus="virtio"/>
Jul 27 12:43:27 user nova-compute[70994]:       <serial>5076fce9-1edf-45c9-b54a-a800ab798fd6</serial>
Jul 27 12:43:27 user nova-compute[70994]:     </disk>
Jul 27 12:43:27 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:27 user nova-compute[70994]:       <mac address="fa:16:3e:13:ab:63"/>
Jul 27 12:43:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:27 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:27 user nova-compute[70994]:       <target dev="tap3f23a04a-22"/>
Jul 27 12:43:27 user nova-compute[70994]:     </interface>
Jul 27 12:43:27 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:27 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/console.log" append="off"/>
Jul 27 12:43:27 user nova-compute[70994]:     </serial>
Jul 27 12:43:27 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:27 user nova-compute[70994]:     <video>
Jul 27 12:43:27 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:27 user nova-compute[70994]:     </video>
Jul 27 12:43:27 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:27 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:27 user nova-compute[70994]:     </rng>
Jul 27 12:43:27 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:27 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:27 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:27 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:27 user nova-compute[70994]:   </devices>
Jul 27 12:43:27 user nova-compute[70994]: </domain>
Jul 27 12:43:27 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='0207b707-fe48-4158-bca9-b172e0a394a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1555823318',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:41:20.086766',shelved_host='user',shelved_image_id='0207b707-fe48-4158-bca9-b172e0a394a3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG os_vif [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f23a04a-22, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f23a04a-22, col_values=(('external_ids', {'iface-id': '3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:ab:63', 'vm-uuid': '4a853286-11ba-4a34-824b-bc59b8a5ac50'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: INFO os_vif [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22')
Jul 27 12:43:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No VIF found with MAC fa:16:3e:13:ab:63, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461809.4565783, aa5113ca-9965-4138-af35-af69b50f9500 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Resumed (Lifecycle Event)
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance spawned successfully.
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461809.4643998, aa5113ca-9965-4138-af35-af69b50f9500 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Started (Lifecycle Event)
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Took 7.91 seconds to spawn the instance on the hypervisor.
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:29 user nova-compute[70994]: INFO nova.compute.manager [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Took 24.20 seconds to build instance.
Jul 27 12:43:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bad63b83-8a78-4e40-9426-d22d02921779 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.437s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:29 user nova-compute[70994]: WARNING nova.compute.manager [req-15dc8af7-94c1-4044-a26d-67232dccd780 req-d8a42b51-e252-4a0e-aa92-56461c111445 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state building and task_state spawning.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461810.180912, f57d289e-51df-412e-89ef-2698eef4453c => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Resumed (Lifecycle Event)
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:30 user nova-compute[70994]: WARNING nova.compute.manager [req-12ec017a-727b-463f-9fcf-3706af816021 req-786bf63d-b375-4762-abcd-77e73127e5a8 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance spawned successfully.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461810.1810107, f57d289e-51df-412e-89ef-2698eef4453c => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Started (Lifecycle Event)
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Took 8.40 seconds to spawn the instance on the hypervisor.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:30 user nova-compute[70994]: INFO nova.compute.manager [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Took 10.63 seconds to build instance.
Jul 27 12:43:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-55b14fc4-b072-40ab-9b51-5947acc41ca1 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.807s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:32 user nova-compute[70994]: WARNING nova.compute.manager [req-b358f162-78bc-4a0d-93f1-d7839fed55c1 req-e7976b46-bb39-4bc2-acae-6a3665501870 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 12:43:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461812.5628955, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:32 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Resumed (Lifecycle Event)
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:43:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance spawned successfully.
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:32 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461812.5648072, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:32 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Started (Lifecycle Event)
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:32 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:43:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-4eb71e82-5d6e-48da-a356-af3b65a114fc tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.273s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:33 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461798.960278, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:33 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Stopped (Lifecycle Event)
Jul 27 12:43:34 user nova-compute[70994]: DEBUG nova.compute.manager [None req-13bdfc78-7f13-4d6b-a645-e3683f3e300b None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:43:35 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Creating image(s)
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.199s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk 1073741824" returned: 0 in 0.075s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.223s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Cannot resize image /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Ensure instance console log exists: /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start _get_guest_xml network_info=[{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ae0f3cc-df1c-4427-9ab7-c7f0171de791', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8a4e71e-262b-499d-860a-c8d26b41c214', 'serial': 'd8a4e71e-262b-499d-860a-c8d26b41c214'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'e3d787eb-0b40-4112-a5ec-cc82bbf5680b', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:36 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 12:43:36 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 12:43:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:36 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:36 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:36 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:36 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:36 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:36 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a69970-5240-4bbf-a514-7cdf4207422d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:43:37 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:37 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.60293197631836GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34e2df-a058-443a-9431-52a35895f25c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214] added
Jul 27 12:43:37 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[645580e9-87df-4c9b-b4e9-d3f777b7817f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe8b2ee-b45e-45ed-9558-b3fe081ca4ed]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzLEZBAv {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzLEZBAv" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85755efe-92c8-46a7-aa97-2e2ccbaf9b58]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzLEZBAv'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f54f77-6f07-49a8-ae01-540533fe84c3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9545f7-0880-42a3-aef4-e4f546e7d804]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:37 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:37 user nova-compute[70994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:37 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:37 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:37 user nova-compute[70994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:37 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2cb0bf10-69e2-4494-9b67-d53d48e83446 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f551a826-789e-4bd2-a6d7-81f3b743a31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802593e-18a0-4cd0-ace4-e24916df2d71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]
Jul 27 12:43:38 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:38 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a342ef-7574-4c84-8c5f-20350e78a2b5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584fac5-bcf6-4a63-aadc-49b28da478fb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:38 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d721b5b-23d2-4094-8dd8-97542651e9d9]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.867s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 12:43:38 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] There are 0 instances to clean {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.209s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== connect_volume: return (2210ms) {'type': 'block', 'scsi_wwn': '26438653534333036', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438653534333036', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1695214911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:39 user nova-compute[70994]:   <uuid>7ae0f3cc-df1c-4427-9ab7-c7f0171de791</uuid>
Jul 27 12:43:39 user nova-compute[70994]:   <name>instance-00000008</name>
Jul 27 12:43:39 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:39 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:39 user nova-compute[70994]:   <metadata>
Jul 27 12:43:39 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:39 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherA-server-1695214911</nova:name>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:36</nova:creationTime>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:39 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:39 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:user uuid="2e02d7aebd3e46beb2f554956eb3804c">tempest-ServerActionsTestOtherA-1320950418-project-member</nova:user>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:project uuid="dba79eb748dd4e26b0be6a26705bda45">tempest-ServerActionsTestOtherA-1320950418</nova:project>
Jul 27 12:43:39 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:43:39 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:39 user nova-compute[70994]:         <nova:port uuid="5389c431-e670-4b72-9d85-ff6cf932bd22">
Jul 27 12:43:39 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:43:39 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:39 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:39 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:39 user nova-compute[70994]:   </metadata>
Jul 27 12:43:39 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:39 user nova-compute[70994]:     <system>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="serial">7ae0f3cc-df1c-4427-9ab7-c7f0171de791</entry>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="uuid">7ae0f3cc-df1c-4427-9ab7-c7f0171de791</entry>
Jul 27 12:43:39 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:39 user nova-compute[70994]:     </system>
Jul 27 12:43:39 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:39 user nova-compute[70994]:   <os>
Jul 27 12:43:39 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:39 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:43:39 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:39 user nova-compute[70994]:   </os>
Jul 27 12:43:39 user nova-compute[70994]:   <features>
Jul 27 12:43:39 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:39 user nova-compute[70994]:     <apic/>
Jul 27 12:43:39 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:39 user nova-compute[70994]:   </features>
Jul 27 12:43:39 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:39 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:39 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:39 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:39 user nova-compute[70994]:   </clock>
Jul 27 12:43:39 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:39 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:39 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:39 user nova-compute[70994]:   </cpu>
Jul 27 12:43:39 user nova-compute[70994]:   <devices>
Jul 27 12:43:39 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:43:39 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:43:39 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk"/>
Jul 27 12:43:39 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:39 user nova-compute[70994]:     </disk>
Jul 27 12:43:39 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:43:39 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:39 user nova-compute[70994]:       <source dev="/dev/sde"/>
Jul 27 12:43:39 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:43:39 user nova-compute[70994]:       <serial>d8a4e71e-262b-499d-860a-c8d26b41c214</serial>
Jul 27 12:43:39 user nova-compute[70994]:     </disk>
Jul 27 12:43:39 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:39 user nova-compute[70994]:       <mac address="fa:16:3e:23:46:4b"/>
Jul 27 12:43:39 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:39 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:39 user nova-compute[70994]:       <target dev="tap5389c431-e6"/>
Jul 27 12:43:39 user nova-compute[70994]:     </interface>
Jul 27 12:43:39 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:39 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/console.log" append="off"/>
Jul 27 12:43:39 user nova-compute[70994]:     </serial>
Jul 27 12:43:39 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:39 user nova-compute[70994]:     <video>
Jul 27 12:43:39 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:39 user nova-compute[70994]:     </video>
Jul 27 12:43:39 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:39 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:39 user nova-compute[70994]:     </rng>
Jul 27 12:43:39 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:39 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:39 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:39 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:39 user nova-compute[70994]:   </devices>
Jul 27 12:43:39 user nova-compute[70994]: </domain>
Jul 27 12:43:39 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1695214911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG os_vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5389c431-e6, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5389c431-e6, col_values=(('external_ids', {'iface-id': '5389c431-e670-4b72-9d85-ff6cf932bd22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:46:4b', 'vm-uuid': '7ae0f3cc-df1c-4427-9ab7-c7f0171de791'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:39 user nova-compute[70994]: INFO os_vif [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6')
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No VIF found with MAC fa:16:3e:23:46:4b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461804.504465, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:39 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Stopped (Lifecycle Event)
Jul 27 12:43:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16dd1f3c-23a6-4c35-bb37-1ba4b6ebe6c9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:43:40 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:43:40 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:41 user nova-compute[70994]: WARNING nova.compute.manager [req-8e3a6f1d-6f84-433b-91e1-099f5de715a5 req-9967ebc7-78d7-4e74-8b83-253a38250afc service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 12:43:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-90e12ac8-347a-4972-b57d-990df00f82c6 req-70aa5ead-30da-4fa9-b34d-1ba554c5cde9 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event volume-reimaged-f32b4fcf-7494-414d-ba47-46f6a1e03f29 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-90e12ac8-347a-4972-b57d-990df00f82c6 req-70aa5ead-30da-4fa9-b34d-1ba554c5cde9 service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-90e12ac8-347a-4972-b57d-990df00f82c6 req-70aa5ead-30da-4fa9-b34d-1ba554c5cde9 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-90e12ac8-347a-4972-b57d-990df00f82c6 req-70aa5ead-30da-4fa9-b34d-1ba554c5cde9 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-90e12ac8-347a-4972-b57d-990df00f82c6 req-70aa5ead-30da-4fa9-b34d-1ba554c5cde9 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Processing event volume-reimaged-f32b4fcf-7494-414d-ba47-46f6a1e03f29 {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:43 user nova-compute[70994]: INFO nova.virt.block_device [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Booting with volume f32b4fcf-7494-414d-ba47-46f6a1e03f29 at /dev/vda
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.utils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:43 user nova-compute[70994]: WARNING nova.compute.manager [req-c668e5fb-a614-4c4d-a6c7-7c029b9a140e req-87a0462e-9c6f-4a37-91f5-a6767a23ab31 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12561aa-ea9d-4278-a201-553df2a77b01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ae644-9c59-4ac8-a1f8-8144ee51ffa2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a7bdb3-5609-4df6-b624-26644a25236b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bedf5f-4f94-4a52-805c-4e8190baf8fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:43:43 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:43:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a64cf21-1c4d-4458-a235-4121765eb7ac]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG os_brick.utils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating existing volume attachment record: f05aed06-7eff-49cf-867f-9e8f90128b34 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461823.8989508, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Resumed (Lifecycle Event)
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:43:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance spawned successfully.
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 12:43:43 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461823.899578, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Started (Lifecycle Event)
Jul 27 12:43:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:44 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 12:43:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 12:43:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c6bf197b-e0b9-4762-8fd1-053034002d96 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:43:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Creating image(s)
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Ensure instance console log exists: /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start _get_guest_xml network_info=[{"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cb0bf10-69e2-4494-9b67-d53d48e83446', 'attached_at': '', 'detached_at': '', 'volume_id': 'f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'serial': 'f32b4fcf-7494-414d-ba47-46f6a1e03f29'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'f05aed06-7eff-49cf-867f-9e8f90128b34', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:51 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 12:43:51 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:43:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:43:51 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7fc293-cc6a-423a-9158-f1f04edaa1dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:43:51 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83b83f-b59e-4d55-9de4-3e291473f813]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29] added
Jul 27 12:43:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c660ec27-f390-4d6b-9237-fb4c0217657c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678dc06-4379-4c34-b8bb-93417ee696e0]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMgHjKTt {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMgHjKTt" returned: 0 in 0.087s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4fea1-fa92-4322-b4de-3bab37ad4859]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMgHjKTt'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b5ee8-6511-475b-83ef-5965cfc228b5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0abe2-7eba-4953-b8aa-c8e07ea8f67c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:51 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:51 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:51 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:51 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd3c5a-5cd0-42d2-93e7-ecaf7a85bfbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]
Jul 27 12:43:52 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.
Jul 27 12:43:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.072s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b905dae-5f8f-43f3-ab3f-cd4a62cb1f88]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4e9b2-57be-4bc6-a410-f6b89039a014]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:43:52 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8552a-c116-489b-bdaf-58c21a7e3d9b]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:43:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '26662666132666165', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662666132666165', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-730231908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:53 user nova-compute[70994]:   <uuid>2cb0bf10-69e2-4494-9b67-d53d48e83446</uuid>
Jul 27 12:43:53 user nova-compute[70994]:   <name>instance-0000000f</name>
Jul 27 12:43:53 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:53 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:53 user nova-compute[70994]:   <metadata>
Jul 27 12:43:53 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:53 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:53 user nova-compute[70994]:       <nova:name>tempest-ServerActionsV293TestJSON-server-730231908</nova:name>
Jul 27 12:43:53 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:51</nova:creationTime>
Jul 27 12:43:53 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:53 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:53 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:53 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:user uuid="549272be22b842818d896dd8e4f79132">tempest-ServerActionsV293TestJSON-771279538-project-member</nova:user>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:project uuid="21bb670b38a14ac6a4583f39b7cfedb7">tempest-ServerActionsV293TestJSON-771279538</nova:project>
Jul 27 12:43:53 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:53 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:53 user nova-compute[70994]:         <nova:port uuid="4f2b0d75-4dee-4bee-8d18-871bf5922540">
Jul 27 12:43:53 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:43:53 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:53 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:53 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:53 user nova-compute[70994]:   </metadata>
Jul 27 12:43:53 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:53 user nova-compute[70994]:     <system>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="serial">2cb0bf10-69e2-4494-9b67-d53d48e83446</entry>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="uuid">2cb0bf10-69e2-4494-9b67-d53d48e83446</entry>
Jul 27 12:43:53 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:53 user nova-compute[70994]:     </system>
Jul 27 12:43:53 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:53 user nova-compute[70994]:   <os>
Jul 27 12:43:53 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:53 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:43:53 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:53 user nova-compute[70994]:   </os>
Jul 27 12:43:53 user nova-compute[70994]:   <features>
Jul 27 12:43:53 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:53 user nova-compute[70994]:     <apic/>
Jul 27 12:43:53 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:53 user nova-compute[70994]:   </features>
Jul 27 12:43:53 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:53 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:53 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:53 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:53 user nova-compute[70994]:   </clock>
Jul 27 12:43:53 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:53 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:53 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:53 user nova-compute[70994]:   </cpu>
Jul 27 12:43:53 user nova-compute[70994]:   <devices>
Jul 27 12:43:53 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:43:53 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:43:53 user nova-compute[70994]:       <source dev="/dev/sdd"/>
Jul 27 12:43:53 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:53 user nova-compute[70994]:       <serial>f32b4fcf-7494-414d-ba47-46f6a1e03f29</serial>
Jul 27 12:43:53 user nova-compute[70994]:     </disk>
Jul 27 12:43:53 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:53 user nova-compute[70994]:       <mac address="fa:16:3e:54:9d:96"/>
Jul 27 12:43:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:53 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:53 user nova-compute[70994]:       <target dev="tap4f2b0d75-4d"/>
Jul 27 12:43:53 user nova-compute[70994]:     </interface>
Jul 27 12:43:53 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:53 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446/console.log" append="off"/>
Jul 27 12:43:53 user nova-compute[70994]:     </serial>
Jul 27 12:43:53 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:53 user nova-compute[70994]:     <video>
Jul 27 12:43:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:53 user nova-compute[70994]:     </video>
Jul 27 12:43:53 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:53 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:53 user nova-compute[70994]:     </rng>
Jul 27 12:43:53 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:53 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:53 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:53 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:53 user nova-compute[70994]:   </devices>
Jul 27 12:43:53 user nova-compute[70994]: </domain>
Jul 27 12:43:53 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-730231908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG os_vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f2b0d75-4d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f2b0d75-4d, col_values=(('external_ids', {'iface-id': '4f2b0d75-4dee-4bee-8d18-871bf5922540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:9d:96', 'vm-uuid': '2cb0bf10-69e2-4494-9b67-d53d48e83446'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:53 user nova-compute[70994]: INFO os_vif [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d')
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] No VIF found with MAC fa:16:3e:54:9d:96, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:55 user nova-compute[70994]: WARNING nova.compute.manager [req-e0d82aee-2069-4064-ab13-11f993ed24ef req-52ed8b85-d6f9-47ff-bdfd-3e933cc3bf7c service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 12:43:56 user nova-compute[70994]: INFO nova.compute.manager [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Rescuing
Jul 27 12:43:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:43:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:43:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.network.neutron [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461837.3040266, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Resumed (Lifecycle Event)
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:57 user nova-compute[70994]: WARNING nova.compute.manager [req-6a206a1d-e349-4a6b-934f-add6fc0e297d req-45f5c924-38c6-4e0f-9a12-40972905936a service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance spawned successfully.
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461837.3043344, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Started (Lifecycle Event)
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 12:43:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance destroyed successfully.
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Attempting rescue
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:43:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Creating image(s)
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-90e12ac8-347a-4972-b57d-990df00f82c6 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.147s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.187s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue" returned: 0 in 0.064s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start _get_guest_xml network_info=[{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:00:43:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'numa_topology' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:58 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:58 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236902550',display_name='tempest-ServerRescueNegativeTestJSON-server-236902550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236902550',id=1,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-mhva2p0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:39:27Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=9a42d4ce-c56b-4ad3-a1b5-61de584a48a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:00:43:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:00:43:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:43:58 user nova-compute[70994]:   <uuid>9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</uuid>
Jul 27 12:43:58 user nova-compute[70994]:   <name>instance-00000001</name>
Jul 27 12:43:58 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:43:58 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:43:58 user nova-compute[70994]:   <metadata>
Jul 27 12:43:58 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:43:58 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-236902550</nova:name>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:43:58</nova:creationTime>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:43:58 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:43:58 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:owner>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:43:58 user nova-compute[70994]:       </nova:owner>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:43:58 user nova-compute[70994]:       <nova:ports>
Jul 27 12:43:58 user nova-compute[70994]:         <nova:port uuid="16971332-b334-4a2d-99a6-2336809450e6">
Jul 27 12:43:58 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 12:43:58 user nova-compute[70994]:         </nova:port>
Jul 27 12:43:58 user nova-compute[70994]:       </nova:ports>
Jul 27 12:43:58 user nova-compute[70994]:     </nova:instance>
Jul 27 12:43:58 user nova-compute[70994]:   </metadata>
Jul 27 12:43:58 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:43:58 user nova-compute[70994]:     <system>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="serial">9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</entry>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="uuid">9a42d4ce-c56b-4ad3-a1b5-61de584a48a7</entry>
Jul 27 12:43:58 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:43:58 user nova-compute[70994]:     </system>
Jul 27 12:43:58 user nova-compute[70994]:   </sysinfo>
Jul 27 12:43:58 user nova-compute[70994]:   <os>
Jul 27 12:43:58 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:43:58 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:43:58 user nova-compute[70994]:   </os>
Jul 27 12:43:58 user nova-compute[70994]:   <features>
Jul 27 12:43:58 user nova-compute[70994]:     <acpi/>
Jul 27 12:43:58 user nova-compute[70994]:     <apic/>
Jul 27 12:43:58 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:43:58 user nova-compute[70994]:   </features>
Jul 27 12:43:58 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:43:58 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:43:58 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:43:58 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:43:58 user nova-compute[70994]:   </clock>
Jul 27 12:43:58 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:43:58 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:43:58 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:43:58 user nova-compute[70994]:   </cpu>
Jul 27 12:43:58 user nova-compute[70994]:   <devices>
Jul 27 12:43:58 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:43:58 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:43:58 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue"/>
Jul 27 12:43:58 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:43:58 user nova-compute[70994]:     </disk>
Jul 27 12:43:58 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:43:58 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:43:58 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk"/>
Jul 27 12:43:58 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:43:58 user nova-compute[70994]:     </disk>
Jul 27 12:43:58 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:43:58 user nova-compute[70994]:       <mac address="fa:16:3e:00:43:57"/>
Jul 27 12:43:58 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:58 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:43:58 user nova-compute[70994]:       <target dev="tap16971332-b3"/>
Jul 27 12:43:58 user nova-compute[70994]:     </interface>
Jul 27 12:43:58 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:43:58 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/console.log" append="off"/>
Jul 27 12:43:58 user nova-compute[70994]:     </serial>
Jul 27 12:43:58 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:43:58 user nova-compute[70994]:     <video>
Jul 27 12:43:58 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:43:58 user nova-compute[70994]:     </video>
Jul 27 12:43:58 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:43:58 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:43:58 user nova-compute[70994]:     </rng>
Jul 27 12:43:58 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:43:58 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:43:58 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:43:58 user nova-compute[70994]:     </memballoon>
Jul 27 12:43:58 user nova-compute[70994]:   </devices>
Jul 27 12:43:58 user nova-compute[70994]: </domain>
Jul 27 12:43:58 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:43:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance destroyed successfully.
Jul 27 12:43:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:43:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:00:43:57, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:59 user nova-compute[70994]: WARNING nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state active and task_state rescuing.
Jul 27 12:43:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:43:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:43:59 user nova-compute[70994]: WARNING nova.compute.manager [req-109205c9-cb9d-449e-857f-df11f525aa02 req-abb1375f-a63f-4e29-92e1-231ef4eda18c service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state active and task_state rescuing.
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state active and task_state rescuing.
Jul 27 12:44:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3f8e6567-43e9-495b-8eb5-f85561127026 req-67f3521d-6bd2-4dc6-a92a-54d3899612a9 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state active and task_state rescuing.
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid b33c60f9-d979-419e-aa9a-9f0844c35e62 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 2e5e427a-a4a8-4a94-bae5-cde57b96959b {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid f551a826-789e-4bd2-a6d7-81f3b743a31b {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: INFO nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e31094ff-43ca-4256-a933-25ee73995818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "aa5113ca-9965-4138-af35-af69b50f9500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f57d289e-51df-412e-89ef-2698eef4453c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "aa5113ca-9965-4138-af35-af69b50f9500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e31094ff-43ca-4256-a933-25ee73995818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f57d289e-51df-412e-89ef-2698eef4453c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.172s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461842.7402828, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:44:02 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Resumed (Lifecycle Event)
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-efc9542d-520b-4820-9f22-7164f986a284 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:44:02 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461842.7437043, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:44:02 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Started (Lifecycle Event)
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:44:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:44:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:26 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:44:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:44:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:44:26 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [{"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-4a853286-11ba-4a34-824b-bc59b8a5ac50" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:38 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:44:39 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:44:39 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=6994MB free_disk=25.627750396728516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2cb0bf10-69e2-4494-9b67-d53d48e83446 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f551a826-789e-4bd2-a6d7-81f3b743a31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing inventories for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating ProviderTree inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing aggregate associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, aggregates: None {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 12:44:39 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing trait associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 12:44:40 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:44:40 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:44:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:44:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.007s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:44 user nova-compute[70994]: INFO nova.compute.manager [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Terminating instance
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-unplugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] No waiting events found dispatching network-vif-unplugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc484429-c9df-4d3d-859d-32af8f38d7a6 req-21d151b5-aaae-4344-9384-d089b190acb4 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-unplugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:44:44 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Instance destroyed successfully.
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.objects.instance [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'resources' on Instance uuid f551a826-789e-4bd2-a6d7-81f3b743a31b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746112795',display_name='tempest-VolumesAdminNegativeTest-server-1746112795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746112795',id=16,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-qkyuozhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:42:49Z,user_data=None,user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=f551a826-789e-4bd2-a6d7-81f3b743a31b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "address": "fa:16:3e:53:70:8c", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7e5bd7-c4", "ovs_interfaceid": "5f7e5bd7-c423-4343-80f1-89ad0915e801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG os_vif [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f7e5bd7-c4, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:44:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:44:45 user nova-compute[70994]: INFO os_vif [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=5f7e5bd7-c423-4343-80f1-89ad0915e801,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7e5bd7-c4')
Jul 27 12:44:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Deleting instance files /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b_del
Jul 27 12:44:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Deletion of /opt/stack/data/nova/instances/f551a826-789e-4bd2-a6d7-81f3b743a31b_del complete
Jul 27 12:44:45 user nova-compute[70994]: INFO nova.compute.manager [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Took 0.83 seconds to destroy the instance on the hypervisor.
Jul 27 12:44:45 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:44:45 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:44:45 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:44:45 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:44:45 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Took 0.67 seconds to deallocate network for instance.
Jul 27 12:44:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:46 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:44:46 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:44:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:46 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Deleted allocations for instance f551a826-789e-4bd2-a6d7-81f3b743a31b
Jul 27 12:44:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7c7a965b-801f-47a3-9d26-a3d61fcd4999 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] Acquiring lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] Lock "f551a826-789e-4bd2-a6d7-81f3b743a31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] No waiting events found dispatching network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:47 user nova-compute[70994]: WARNING nova.compute.manager [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received unexpected event network-vif-plugged-5f7e5bd7-c423-4343-80f1-89ad0915e801 for instance with vm_state deleted and task_state None.
Jul 27 12:44:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9c74bfd-79d6-4a51-b1d6-8775d30bb5de req-34a983cf-5f01-4195-946f-779e27f22409 service nova] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Received event network-vif-deleted-5f7e5bd7-c423-4343-80f1-89ad0915e801 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:44:51 user nova-compute[70994]: INFO nova.compute.claims [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Claim successful on node user
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:44:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:44:51 user nova-compute[70994]: DEBUG nova.policy [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6732bc36ed624e9ea1464f56036ad866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b59d9a59094d3392ea26f8c280b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:44:52 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Creating image(s)
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.178s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk 1073741824" returned: 0 in 0.060s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.179s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Successfully created port: 4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Cannot resize image /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.objects.instance [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'migration_context' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Ensure instance console log exists: /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Successfully updated port: 4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-changed-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing instance network info cache due to event network-changed-4fd073ea-1892-4d4b-be31-f770ebbc4312. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.neutron [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Instance network_info: |[{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing network info cache for port 4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Start _get_guest_xml network_info=[{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:44:54 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:44:54 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.objects.instance [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'pci_devices' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:44:54 user nova-compute[70994]:   <uuid>526e9d52-53e8-4c83-b147-08dbf52f6aff</uuid>
Jul 27 12:44:54 user nova-compute[70994]:   <name>instance-00000013</name>
Jul 27 12:44:54 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:44:54 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:44:54 user nova-compute[70994]:   <metadata>
Jul 27 12:44:54 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:44:54 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:44:54</nova:creationTime>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:44:54 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:44:54 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:owner>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:44:54 user nova-compute[70994]:       </nova:owner>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:44:54 user nova-compute[70994]:       <nova:ports>
Jul 27 12:44:54 user nova-compute[70994]:         <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:44:54 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:44:54 user nova-compute[70994]:         </nova:port>
Jul 27 12:44:54 user nova-compute[70994]:       </nova:ports>
Jul 27 12:44:54 user nova-compute[70994]:     </nova:instance>
Jul 27 12:44:54 user nova-compute[70994]:   </metadata>
Jul 27 12:44:54 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:44:54 user nova-compute[70994]:     <system>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="serial">526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="uuid">526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:44:54 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:44:54 user nova-compute[70994]:     </system>
Jul 27 12:44:54 user nova-compute[70994]:   </sysinfo>
Jul 27 12:44:54 user nova-compute[70994]:   <os>
Jul 27 12:44:54 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:44:54 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:44:54 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:44:54 user nova-compute[70994]:   </os>
Jul 27 12:44:54 user nova-compute[70994]:   <features>
Jul 27 12:44:54 user nova-compute[70994]:     <acpi/>
Jul 27 12:44:54 user nova-compute[70994]:     <apic/>
Jul 27 12:44:54 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:44:54 user nova-compute[70994]:   </features>
Jul 27 12:44:54 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:44:54 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:44:54 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:44:54 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:44:54 user nova-compute[70994]:   </clock>
Jul 27 12:44:54 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:44:54 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:44:54 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:44:54 user nova-compute[70994]:   </cpu>
Jul 27 12:44:54 user nova-compute[70994]:   <devices>
Jul 27 12:44:54 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:44:54 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:44:54 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk"/>
Jul 27 12:44:54 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:44:54 user nova-compute[70994]:     </disk>
Jul 27 12:44:54 user nova-compute[70994]:     <disk type="file" device="cdrom">
Jul 27 12:44:54 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 12:44:54 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config"/>
Jul 27 12:44:54 user nova-compute[70994]:       <target dev="hda" bus="ide"/>
Jul 27 12:44:54 user nova-compute[70994]:     </disk>
Jul 27 12:44:54 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:44:54 user nova-compute[70994]:       <mac address="fa:16:3e:be:d6:51"/>
Jul 27 12:44:54 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:44:54 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:44:54 user nova-compute[70994]:       <target dev="tap4fd073ea-18"/>
Jul 27 12:44:54 user nova-compute[70994]:     </interface>
Jul 27 12:44:54 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:44:54 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log" append="off"/>
Jul 27 12:44:54 user nova-compute[70994]:     </serial>
Jul 27 12:44:54 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:44:54 user nova-compute[70994]:     <video>
Jul 27 12:44:54 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:44:54 user nova-compute[70994]:     </video>
Jul 27 12:44:54 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:44:54 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:44:54 user nova-compute[70994]:     </rng>
Jul 27 12:44:54 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:44:54 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:44:54 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:44:54 user nova-compute[70994]:     </memballoon>
Jul 27 12:44:54 user nova-compute[70994]:   </devices>
Jul 27 12:44:54 user nova-compute[70994]: </domain>
Jul 27 12:44:54 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG os_vif [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fd073ea-18, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fd073ea-18, col_values=(('external_ids', {'iface-id': '4fd073ea-1892-4d4b-be31-f770ebbc4312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d6:51', 'vm-uuid': '526e9d52-53e8-4c83-b147-08dbf52f6aff'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:54 user nova-compute[70994]: INFO os_vif [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18')
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name hda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:44:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No VIF found with MAC fa:16:3e:be:d6:51, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:44:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Using config drive
Jul 27 12:44:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Creating config drive at /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config
Jul 27 12:44:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpff7prdcq {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:55 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updated VIF entry in instance network info cache for port 4fd073ea-1892-4d4b-be31-f770ebbc4312. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:44:55 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:44:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e907a9d-ef08-43fe-b260-4daa8936a74a req-fe0c14fa-caa5-4305-96a7-c94edc899481 service nova] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:44:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpff7prdcq" returned: 0 in 0.073s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:57 user nova-compute[70994]: WARNING nova.compute.manager [req-e35d58ec-04f8-4dd6-930b-3f868748f462 req-56499d29-de5e-4c1a-9fb4-371c78d9e9ca service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 for instance with vm_state building and task_state spawning.
Jul 27 12:44:57 user nova-compute[70994]: INFO nova.compute.manager [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Rescuing
Jul 27 12:44:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG nova.network.neutron [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.network.neutron [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:58 user nova-compute[70994]: INFO nova.compute.manager [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Detaching volume 5076fce9-1edf-45c9-b54a-a800ab798fd6
Jul 27 12:44:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:58 user nova-compute[70994]: INFO nova.virt.block_device [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Attempting to driver detach volume 5076fce9-1edf-45c9-b54a-a800ab798fd6 from mountpoint /dev/vdc
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Attempting to detach device vdc from instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:44:58 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:44:58 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:44:58 user nova-compute[70994]:   <target dev="vdc" bus="virtio"/>
Jul 27 12:44:58 user nova-compute[70994]:   <serial>5076fce9-1edf-45c9-b54a-a800ab798fd6</serial>
Jul 27 12:44:58 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:44:58 user nova-compute[70994]: </disk>
Jul 27 12:44:58 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:44:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully detached device vdc from instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 from the persistent domain config.
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:44:58 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:44:58 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:44:58 user nova-compute[70994]:   <target dev="vdc" bus="virtio"/>
Jul 27 12:44:58 user nova-compute[70994]:   <serial>5076fce9-1edf-45c9-b54a-a800ab798fd6</serial>
Jul 27 12:44:58 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:44:58 user nova-compute[70994]: </disk>
Jul 27 12:44:58 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:58 user nova-compute[70994]: WARNING nova.compute.manager [req-f46dada1-5e90-4f90-b71e-d141f301a8d8 req-fbe1ee3d-9404-457b-8156-f76b864b64c6 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:44:59 user nova-compute[70994]: WARNING nova.compute.manager [req-40a86ad7-9c46-484d-b148-d2ad6ba3a9c2 req-dd5bc27e-9682-4fad-92aa-5d1f45635213 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 for instance with vm_state building and task_state spawning.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690461899.6625042, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully detached device vdc from instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 from the live domain config.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhZfiBGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:44:59 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance destroyed successfully.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Attempting a stable device rescue
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1359543f-35a1-4e70-97cf-d99287d1e4ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:44:59 user nova-compute[70994]: No targets found.
Jul 27 12:44:59 user nova-compute[70994]: iSNS:
Jul 27 12:44:59 user nova-compute[70994]: No targets found.
Jul 27 12:44:59 user nova-compute[70994]: STATIC:
Jul 27 12:44:59 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:44:59 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:44:59 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:44:59 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6
Jul 27 12:44:59 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:44:59 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:44:59 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:44:59 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:44:59 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:44:59 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:44:59 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:44:59 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:44:59 user nova-compute[70994]: FIRMWARE:
Jul 27 12:44:59 user nova-compute[70994]: No targets found.
Jul 27 12:44:59 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:44:59 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:44:59 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[849d522c-aed2-4d77-bb23-775161110b43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Creating image(s)
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "67df471c9221339d9bfb075bd445e5221d492632" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "67df471c9221339d9bfb075bd445e5221d492632" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41db5f-1898-4a6c-a209-af71b024a95b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:44:59 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4301f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461899.8331206, 526e9d52-53e8-4c83-b147-08dbf52f6aff => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] VM Resumed (Lifecycle Event)
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a5a56-99a8-4356-b804-e239ad26101b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Instance spawned successfully.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1f01d-6987-480a-b7ca-90e21ab98836]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2bf62-c4c6-43b4-89b6-2222e1d625b0]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:44:59 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461899.8366773, 526e9d52-53e8-4c83-b147-08dbf52f6aff => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:44:59 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] VM Started (Lifecycle Event)
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461884.9556267, f551a826-789e-4bd2-a6d7-81f3b743a31b => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:01 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] VM Stopped (Lifecycle Event)
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbadcd4-c441-4082-80df-4fe0411a848a]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:01 user nova-compute[70994]: INFO nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Took 9.11 seconds to spawn the instance on the hypervisor.
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:01 user nova-compute[70994]: WARNING nova.compute.manager [req-3de04489-4109-4352-a6d9-b26746a14641 req-15c55fdc-7062-436a-97a5-ce7ca3b23967 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a95ce112-7ca7-4b51-bf0a-a76e4c2b9892 None None] [instance: f551a826-789e-4bd2-a6d7-81f3b743a31b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d17d99-8126-46e2-b6e9-3b2512fecea2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.part --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.virt.images [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] 0ded1980-f506-41ba-b6b3-668d8ab25b5c was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.part /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28482e1c-d93a-4e85-b7fa-cafe9a3abddf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260]
Jul 27 12:45:01 user nova-compute[70994]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6, portal: 172.16.0.220,3260] successful.
Jul 27 12:45:01 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5076fce9-1edf-45c9-b54a-a800ab798fd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286645f-504a-4df0-9430-46d30c4deff1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.701s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] <== disconnect_volume: return (1702ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:45:01 user nova-compute[70994]: INFO nova.compute.manager [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Took 10.12 seconds to build instance.
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61967193-2dee-4bed-b5ec-b2d102a9cea5 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.270s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.part /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.converted" returned: 0 in 0.352s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "67df471c9221339d9bfb075bd445e5221d492632" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.086s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "67df471c9221339d9bfb075bd445e5221d492632" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "67df471c9221339d9bfb075bd445e5221d492632" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:01 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632 --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632,backing_fmt=raw /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67df471c9221339d9bfb075bd445e5221d492632,backing_fmt=raw /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue" returned: 0 in 0.051s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "67df471c9221339d9bfb075bd445e5221d492632" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'migration_context' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start _get_guest_xml network_info=[{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:87:82:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ded1980-f506-41ba-b6b3-668d8ab25b5c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aa5113ca-9965-4138-af35-af69b50f9500', 'attached_at': '', 'detached_at': '', 'volume_id': '0ee3171b-e8ff-47d2-8f38-01742340240c', 'serial': '0ee3171b-e8ff-47d2-8f38-01742340240c'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '914719db-14aa-48fa-a73c-ff94b90e04e0', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'numa_topology' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:02 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:45:02 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2eb464-b6db-425f-ba7d-488acc409e43]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rtKAPNDj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 12:45:02 user nova-compute[70994]: node.name = iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:45:02 user nova-compute[70994]: node.tpgt = -1
Jul 27 12:45:02 user nova-compute[70994]: node.startup = automatic
Jul 27 12:45:02 user nova-compute[70994]: node.leading_login = No
Jul 27 12:45:02 user nova-compute[70994]: iface.iscsi_ifacename = default
Jul 27 12:45:02 user nova-compute[70994]: iface.net_ifacename = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.ipaddress = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.prefix_len = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.hwaddress = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.transport_name = tcp
Jul 27 12:45:02 user nova-compute[70994]: iface.initiatorname = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.vlan_id = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.vlan_priority = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.vlan_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.iface_num = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.mtu = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.port = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.bootproto = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.subnet_mask = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.gateway = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_alt_client_id = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_dns = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_learn_iqn = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_vendor_id_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_vendor_id = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.dhcp_slp_da = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.fragmentation = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.gratuitous_arp = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.incoming_forwarding = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.tos_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.tos = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.ttl = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.delayed_ack = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.tcp_nagle = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.tcp_wsf_state = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.tcp_wsf = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.tcp_timer_scale = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.tcp_timestamp = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.redirect = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.def_task_mgmt_timeout = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.header_digest = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.data_digest = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.immediate_data = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.initial_r2t = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.data_seq_inorder = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.data_pdu_inorder = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.erl = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.max_receive_data_len = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.first_burst_len = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.max_outstanding_r2t = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.max_burst_len = 0
Jul 27 12:45:02 user nova-compute[70994]: iface.chap_auth = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.bidi_chap = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.strict_login_compliance = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.discovery_auth = <empty>
Jul 27 12:45:02 user nova-compute[70994]: iface.discovery_logout = <empty>
Jul 27 12:45:02 user nova-compute[70994]: node.discovery_address = <empty>
Jul 27 12:45:02 user nova-compute[70994]: node.discovery_port = 0
Jul 27 12:45:02 user nova-compute[70994]: node.discovery_type = static
Jul 27 12:45:02 user nova-compute[70994]: node.session.initial_cmdsn = 0
Jul 27 12:45:02 user nova-compute[70994]: node.session.initial_login_retry_max = 8
Jul 27 12:45:02 user nova-compute[70994]: node.session.xmit_thread_priority = -20
Jul 27 12:45:02 user nova-compute[70994]: node.session.cmds_max = 128
Jul 27 12:45:02 user nova-compute[70994]: node.session.queue_depth = 32
Jul 27 12:45:02 user nova-compute[70994]: node.session.nr_sessions = 1
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.authmethod = CHAP
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.username = rtKAPNDj
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.password = ***
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.username_in = <empty>
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.password_in = <empty>
Jul 27 12:45:02 user nova-compute[70994]: node.session.auth.chap_algs = MD5
Jul 27 12:45:02 user nova-compute[70994]: node.session.timeo.replacement_timeout = 120
Jul 27 12:45:02 user nova-compute[70994]: node.session.err_timeo.abort_timeout = 15
Jul 27 12:45:02 user nova-compute[70994]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 12:45:02 user nova-compute[70994]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 12:45:02 user nova-compute[70994]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.FastAbort = Yes
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.InitialR2T = No
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.ImmediateData = Yes
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.MaxConnections = 1
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 12:45:02 user nova-compute[70994]: node.session.iscsi.ERL = 0
Jul 27 12:45:02 user nova-compute[70994]: node.session.scan = manual
Jul 27 12:45:02 user nova-compute[70994]: node.session.reopen_max = 0
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].address = 172.16.0.220
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].port = 3260
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].startup = manual
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].tcp.window_size = 524288
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].tcp.type_of_service = 0
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].timeo.logout_timeout = 15
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].timeo.login_timeout = 15
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].timeo.auth_timeout = 45
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.DataDigest = None
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.IFMarker = No
Jul 27 12:45:02 user nova-compute[70994]: node.conn[0].iscsi.OFMarker = No
Jul 27 12:45:02 user nova-compute[70994]: # END RECORD
Jul 27 12:45:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'flavor' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f939c3-74a8-46e1-b80f-5204452cf987]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28459122-a300-440b-b325-4befa0d54470]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtKAPNDj {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-83f9cb8a-f085-4dd2-9068-d53294921299 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.895s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtKAPNDj" returned: 0 in 0.035s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395d259-8d2c-4eb9-9113-96c73d41cce9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtKAPNDj'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28ae4d-2ae2-4fce-8421-30c402197d46]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37953e0f-1721-4114-bc54-e76256f74c7a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:45:02 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:45:02 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:45:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:45:02 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:45:02 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:45:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc63f04a-401c-43e7-aaa0-feb7177ddfe9]: (4, ('0 0 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.239s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== connect_volume: return (240ms) {'type': 'block', 'scsi_wwn': '23735393165316263', 'path': '/dev/sdc'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735393165316263', 'path': '/dev/sdc'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262489840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262489840',id=17,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-esrxz47u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:43:30Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=aa5113ca-9965-4138-af35-af69b50f9500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:87:82:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:87:82:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:45:02 user nova-compute[70994]:   <uuid>aa5113ca-9965-4138-af35-af69b50f9500</uuid>
Jul 27 12:45:02 user nova-compute[70994]:   <name>instance-00000011</name>
Jul 27 12:45:02 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:45:02 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:45:02 user nova-compute[70994]:   <metadata>
Jul 27 12:45:02 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:45:02 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1262489840</nova:name>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:45:02</nova:creationTime>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:45:02 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:45:02 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:owner>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:45:02 user nova-compute[70994]:       </nova:owner>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:45:02 user nova-compute[70994]:       <nova:ports>
Jul 27 12:45:02 user nova-compute[70994]:         <nova:port uuid="559742f0-5d2f-414b-9963-35b75a83c42f">
Jul 27 12:45:02 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:45:02 user nova-compute[70994]:         </nova:port>
Jul 27 12:45:02 user nova-compute[70994]:       </nova:ports>
Jul 27 12:45:02 user nova-compute[70994]:     </nova:instance>
Jul 27 12:45:02 user nova-compute[70994]:   </metadata>
Jul 27 12:45:02 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:45:02 user nova-compute[70994]:     <system>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="serial">aa5113ca-9965-4138-af35-af69b50f9500</entry>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="uuid">aa5113ca-9965-4138-af35-af69b50f9500</entry>
Jul 27 12:45:02 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:45:02 user nova-compute[70994]:     </system>
Jul 27 12:45:02 user nova-compute[70994]:   </sysinfo>
Jul 27 12:45:02 user nova-compute[70994]:   <os>
Jul 27 12:45:02 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:45:02 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:45:02 user nova-compute[70994]:   </os>
Jul 27 12:45:02 user nova-compute[70994]:   <features>
Jul 27 12:45:02 user nova-compute[70994]:     <acpi/>
Jul 27 12:45:02 user nova-compute[70994]:     <apic/>
Jul 27 12:45:02 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:45:02 user nova-compute[70994]:   </features>
Jul 27 12:45:02 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:45:02 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:45:02 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:45:02 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:45:02 user nova-compute[70994]:   </clock>
Jul 27 12:45:02 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:45:02 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:45:02 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:45:02 user nova-compute[70994]:   </cpu>
Jul 27 12:45:02 user nova-compute[70994]:   <devices>
Jul 27 12:45:02 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:45:02 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:45:02 user nova-compute[70994]:       <source dev="/dev/sdc"/>
Jul 27 12:45:02 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:45:02 user nova-compute[70994]:       <serial>0ee3171b-e8ff-47d2-8f38-01742340240c</serial>
Jul 27 12:45:02 user nova-compute[70994]:     </disk>
Jul 27 12:45:02 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:45:02 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:45:02 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue"/>
Jul 27 12:45:02 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:45:02 user nova-compute[70994]:       <boot order="1"/>
Jul 27 12:45:02 user nova-compute[70994]:     </disk>
Jul 27 12:45:02 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:45:02 user nova-compute[70994]:       <mac address="fa:16:3e:87:82:18"/>
Jul 27 12:45:02 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:45:02 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:45:02 user nova-compute[70994]:       <target dev="tap559742f0-5d"/>
Jul 27 12:45:02 user nova-compute[70994]:     </interface>
Jul 27 12:45:02 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:45:02 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/console.log" append="off"/>
Jul 27 12:45:02 user nova-compute[70994]:     </serial>
Jul 27 12:45:02 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:45:02 user nova-compute[70994]:     <video>
Jul 27 12:45:02 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:45:02 user nova-compute[70994]:     </video>
Jul 27 12:45:02 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:45:02 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:45:02 user nova-compute[70994]:     </rng>
Jul 27 12:45:02 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:45:02 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:45:02 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:45:02 user nova-compute[70994]:     </memballoon>
Jul 27 12:45:02 user nova-compute[70994]:   </devices>
Jul 27 12:45:02 user nova-compute[70994]: </domain>
Jul 27 12:45:02 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance destroyed successfully.
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:87:82:18, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:02 user nova-compute[70994]: WARNING nova.compute.manager [req-77cd3f92-c63a-4a71-982e-c05f5a9ae966 req-ead24d00-48e1-4d22-ab1b-49fdafe50b88 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:05 user nova-compute[70994]: WARNING nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:05 user nova-compute[70994]: WARNING nova.compute.manager [req-a52db022-0b16-4512-b4fa-1299edaadec5 req-4dd0296e-37df-40ab-9395-2c1ba6d564be service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state rescuing.
Jul 27 12:45:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for aa5113ca-9965-4138-af35-af69b50f9500 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461906.9071314, aa5113ca-9965-4138-af35-af69b50f9500 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:06 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Resumed (Lifecycle Event)
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-5feaa2da-407a-4fb6-be8f-f67c708acc41 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:06 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461906.9073184, aa5113ca-9965-4138-af35-af69b50f9500 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:06 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Started (Lifecycle Event)
Jul 27 12:45:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:10 user nova-compute[70994]: INFO nova.compute.manager [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Terminating instance
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Instance destroyed successfully.
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'resources' on Instance uuid 2cb0bf10-69e2-4494-9b67-d53d48e83446 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-730231908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1356447569',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgzeXWC4nk/QI0l/5n2towuwWh5OLgQcWsX1k8dFU6v+LFep7Hsm1feDYFQQgt/ori2HJS3BHUgTHHAdQcS/87rGwmfw9iGYBVp9/FfqkZEbFP+rBBBKcb5FiNp/rBwrA==',key_name='tempest-keypair-1080267724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-rczp00su',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:43:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2cb0bf10-69e2-4494-9b67-d53d48e83446,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "address": "fa:16:3e:54:9d:96", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f2b0d75-4d", "ovs_interfaceid": "4f2b0d75-4dee-4bee-8d18-871bf5922540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_vif [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-bcfca9fd-e9ed-4f55-b840-d6b0a8ec45a7 req-a1143ea4-42e2-4a1b-92e0-c5cd5efe60f2 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-unplugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f2b0d75-4d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:10 user nova-compute[70994]: INFO os_vif [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9d:96,bridge_name='br-int',has_traffic_filtering=True,id=4f2b0d75-4dee-4bee-8d18-871bf5922540,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f2b0d75-4d')
Jul 27 12:45:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMgHjKTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:45:10 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b78bd-4039-4ddf-990a-80c00b735a86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:45:10 user nova-compute[70994]: No targets found.
Jul 27 12:45:10 user nova-compute[70994]: iSNS:
Jul 27 12:45:10 user nova-compute[70994]: No targets found.
Jul 27 12:45:10 user nova-compute[70994]: STATIC:
Jul 27 12:45:10 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:45:10 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:45:10 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:45:10 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29
Jul 27 12:45:10 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:45:10 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:45:10 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:45:10 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:45:10 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:45:10 user nova-compute[70994]: FIRMWARE:
Jul 27 12:45:10 user nova-compute[70994]: No targets found.
Jul 27 12:45:10 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:45:10 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:45:10 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:45:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d6441-fcd6-41ab-9309-d994a2d94255]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[746e0f6e-c7f9-4a09-a412-c0463eaae798]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:45:11 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:45:11 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:45:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:45:11 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:45:11 user nova-compute[70994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 (non-flash)
Jul 27 12:45:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc725ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf772e-313a-4607-bdcc-ed0e5fe870dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f650d0e-2b71-45ac-9b80-d2ec186f4e41]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825d581-f01c-495a-9055-5a818c266cf4]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55bfe0-9963-4587-9073-509ddb546b5d]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4596e7c5', '/dev/disk/by-id/scsi-26662666132666165', '/dev/disk/by-id/scsi-1SCST_BIO4596e7c5-fbfa2fae19166002') {{(pid=82465) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515c95c-570a-4897-ac4c-4ecea5dc9056]: (4, None) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b223e7-6e9b-4e5b-b8f3-ae26edfea475]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc853e2-123f-4f0c-8223-0dfe5235df6c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260]
Jul 27 12:45:11 user nova-compute[70994]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29, portal: 172.16.0.220,3260] successful.
Jul 27 12:45:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32b4fcf-7494-414d-ba47-46f6a1e03f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b6fd4-f417-4d1a-a794-4de61afe8d2f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] <== disconnect_volume: return (415ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:45:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deleting instance files /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446_del
Jul 27 12:45:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deletion of /opt/stack/data/nova/instances/2cb0bf10-69e2-4494-9b67-d53d48e83446_del complete
Jul 27 12:45:11 user nova-compute[70994]: INFO nova.compute.manager [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Took 1.37 seconds to destroy the instance on the hypervisor.
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-changed-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Refreshing instance network info cache due to event network-changed-3418446e-e2a1-4516-a37e-be94d79fbf4f. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:45:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Refreshing network info cache for port 3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:45:12 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:12 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Took 0.94 seconds to deallocate network for instance.
Jul 27 12:45:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] Acquiring lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] No waiting events found dispatching network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:13 user nova-compute[70994]: WARNING nova.compute.manager [req-e73b8094-b4b7-4724-a91b-5f280d791712 req-3092bb9a-7c23-49df-aa69-d41fe78ed28b service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received unexpected event network-vif-plugged-4f2b0d75-4dee-4bee-8d18-871bf5922540 for instance with vm_state active and task_state deleting.
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updated VIF entry in instance network info cache for port 3418446e-e2a1-4516-a37e-be94d79fbf4f. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-834693f8-e790-41e1-ba89-9395d039ed63 req-9986d6c2-6839-4ea2-9275-795e2c40ebcc service nova] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:45:13 user nova-compute[70994]: INFO nova.compute.manager [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Took 0.85 seconds to detach 1 volumes for instance.
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Deleting volume: f32b4fcf-7494-414d-ba47-46f6a1e03f29 {{(pid=70994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-08327cbe-2153-4bd3-a5d6-bae91a61cd2b req-cda28c27-a8a4-4355-9be6-034dfa562ee6 service nova] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Received event network-vif-deleted-4f2b0d75-4dee-4bee-8d18-871bf5922540 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:45:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:14 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Deleted allocations for instance 2cb0bf10-69e2-4494-9b67-d53d48e83446
Jul 27 12:45:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b8256bfb-96ab-4c54-b6cd-4cb16bb937f2 tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2cb0bf10-69e2-4494-9b67-d53d48e83446" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.081s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:45:20 user nova-compute[70994]: INFO nova.compute.claims [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Claim successful on node user
Jul 27 12:45:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:45:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.policy [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9007dda5491b4be58773e5d5fdf4278c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a37134c2e84d14aa2d476053deeab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:45:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Creating image(s)
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "/opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "/opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.162s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk 1073741824" returned: 0 in 0.054s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Cannot resize image /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'migration_context' on Instance uuid b4befc11-c528-4b29-bdd4-e3d0e9b82700 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Ensure instance console log exists: /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Successfully created port: decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:45:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Successfully updated port: decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquired lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-changed-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Refreshing instance network info cache due to event network-changed-decea308-29ed-4464-8a7d-f78e87b8e1a9. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] Acquiring lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Updating instance_info_cache with network_info: [{"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Releasing lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Instance network_info: |[{"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] Acquired lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Refreshing network info cache for port decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Start _get_guest_xml network_info=[{"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:45:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:45:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772848237',display_name='tempest-VolumesActionsTest-instance-1772848237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772848237',id=20,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-bsry0hls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:45:22Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=b4befc11-c528-4b29-bdd4-e3d0e9b82700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'pci_devices' on Instance uuid b4befc11-c528-4b29-bdd4-e3d0e9b82700 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:45:23 user nova-compute[70994]:   <uuid>b4befc11-c528-4b29-bdd4-e3d0e9b82700</uuid>
Jul 27 12:45:23 user nova-compute[70994]:   <name>instance-00000014</name>
Jul 27 12:45:23 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:45:23 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:45:23 user nova-compute[70994]:   <metadata>
Jul 27 12:45:23 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:45:23 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:name>tempest-VolumesActionsTest-instance-1772848237</nova:name>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:45:23</nova:creationTime>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:45:23 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:45:23 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:owner>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:user uuid="9007dda5491b4be58773e5d5fdf4278c">tempest-VolumesActionsTest-757189479-project-member</nova:user>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:project uuid="01a37134c2e84d14aa2d476053deeab5">tempest-VolumesActionsTest-757189479</nova:project>
Jul 27 12:45:23 user nova-compute[70994]:       </nova:owner>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:45:23 user nova-compute[70994]:       <nova:ports>
Jul 27 12:45:23 user nova-compute[70994]:         <nova:port uuid="decea308-29ed-4464-8a7d-f78e87b8e1a9">
Jul 27 12:45:23 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 12:45:23 user nova-compute[70994]:         </nova:port>
Jul 27 12:45:23 user nova-compute[70994]:       </nova:ports>
Jul 27 12:45:23 user nova-compute[70994]:     </nova:instance>
Jul 27 12:45:23 user nova-compute[70994]:   </metadata>
Jul 27 12:45:23 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:45:23 user nova-compute[70994]:     <system>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="serial">b4befc11-c528-4b29-bdd4-e3d0e9b82700</entry>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="uuid">b4befc11-c528-4b29-bdd4-e3d0e9b82700</entry>
Jul 27 12:45:23 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:45:23 user nova-compute[70994]:     </system>
Jul 27 12:45:23 user nova-compute[70994]:   </sysinfo>
Jul 27 12:45:23 user nova-compute[70994]:   <os>
Jul 27 12:45:23 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:45:23 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:45:23 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:45:23 user nova-compute[70994]:   </os>
Jul 27 12:45:23 user nova-compute[70994]:   <features>
Jul 27 12:45:23 user nova-compute[70994]:     <acpi/>
Jul 27 12:45:23 user nova-compute[70994]:     <apic/>
Jul 27 12:45:23 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:45:23 user nova-compute[70994]:   </features>
Jul 27 12:45:23 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:45:23 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:45:23 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:45:23 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:45:23 user nova-compute[70994]:   </clock>
Jul 27 12:45:23 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:45:23 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:45:23 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:45:23 user nova-compute[70994]:   </cpu>
Jul 27 12:45:23 user nova-compute[70994]:   <devices>
Jul 27 12:45:23 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:45:23 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:45:23 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk"/>
Jul 27 12:45:23 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:45:23 user nova-compute[70994]:     </disk>
Jul 27 12:45:23 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:45:23 user nova-compute[70994]:       <mac address="fa:16:3e:a5:9e:e1"/>
Jul 27 12:45:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:45:23 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:45:23 user nova-compute[70994]:       <target dev="tapdecea308-29"/>
Jul 27 12:45:23 user nova-compute[70994]:     </interface>
Jul 27 12:45:23 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:45:23 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/console.log" append="off"/>
Jul 27 12:45:23 user nova-compute[70994]:     </serial>
Jul 27 12:45:23 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:45:23 user nova-compute[70994]:     <video>
Jul 27 12:45:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:45:23 user nova-compute[70994]:     </video>
Jul 27 12:45:23 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:45:23 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:45:23 user nova-compute[70994]:     </rng>
Jul 27 12:45:23 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:45:23 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:45:23 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:45:23 user nova-compute[70994]:     </memballoon>
Jul 27 12:45:23 user nova-compute[70994]:   </devices>
Jul 27 12:45:23 user nova-compute[70994]: </domain>
Jul 27 12:45:23 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:45:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772848237',display_name='tempest-VolumesActionsTest-instance-1772848237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772848237',id=20,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-bsry0hls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:45:22Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=b4befc11-c528-4b29-bdd4-e3d0e9b82700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG os_vif [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdecea308-29, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdecea308-29, col_values=(('external_ids', {'iface-id': 'decea308-29ed-4464-8a7d-f78e87b8e1a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:9e:e1', 'vm-uuid': 'b4befc11-c528-4b29-bdd4-e3d0e9b82700'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:23 user nova-compute[70994]: INFO os_vif [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29')
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:45:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] No VIF found with MAC fa:16:3e:a5:9e:e1, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:45:24 user nova-compute[70994]: DEBUG nova.network.neutron [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Updated VIF entry in instance network info cache for port decea308-29ed-4464-8a7d-f78e87b8e1a9. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:45:24 user nova-compute[70994]: DEBUG nova.network.neutron [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Updating instance_info_cache with network_info: [{"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-be69d821-e99c-4aa1-836d-8f3ff2a677aa req-630af95d-c627-4af6-b754-ca8c3a3b8fb6 service nova] Releasing lock "refresh_cache-b4befc11-c528-4b29-bdd4-e3d0e9b82700" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] No waiting events found dispatching network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:25 user nova-compute[70994]: WARNING nova.compute.manager [req-669fc264-c012-4967-95c0-6f867f2349a7 req-f9a3a2b0-ab88-41fa-b5d7-3a3a39ab2b12 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received unexpected event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 for instance with vm_state building and task_state spawning.
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:25 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461910.876206, 2cb0bf10-69e2-4494-9b67-d53d48e83446 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:25 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] VM Stopped (Lifecycle Event)
Jul 27 12:45:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-60a88627-3258-4984-9838-a5f842f8d699 None None] [instance: 2cb0bf10-69e2-4494-9b67-d53d48e83446] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461927.3910375, b4befc11-c528-4b29-bdd4-e3d0e9b82700 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] VM Resumed (Lifecycle Event)
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Instance spawned successfully.
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461927.3946483, b4befc11-c528-4b29-bdd4-e3d0e9b82700 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] VM Started (Lifecycle Event)
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] No waiting events found dispatching network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:27 user nova-compute[70994]: WARNING nova.compute.manager [req-15186271-6935-4277-b994-4ffe886f1d99 req-f989e98c-8467-486d-a401-263b61572d62 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received unexpected event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 for instance with vm_state building and task_state spawning.
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Took 5.93 seconds to spawn the instance on the hypervisor.
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:27 user nova-compute[70994]: INFO nova.compute.manager [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Took 6.75 seconds to build instance.
Jul 27 12:45:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3407a40a-df47-43b3-b05e-b5520db517de tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updating instance_info_cache with network_info: [{"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-2e5e427a-a4a8-4a94-bae5-cde57b96959b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:32 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:45:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:45:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=25.51485824584961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:41 user nova-compute[70994]: INFO nova.compute.manager [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Terminating instance
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 5d2440a0-860c-4700-9fed-224851bec304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 526e9d52-53e8-4c83-b147-08dbf52f6aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b4befc11-c528-4b29-bdd4-e3d0e9b82700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-unplugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] No waiting events found dispatching network-vif-unplugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-4c100aa8-2c09-4383-96a7-95234bf4f974 req-dd634953-83e7-4638-a01a-67ffc042f32f service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-unplugged-294180fe-682a-4cae-89ad-834369b928a5 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Instance destroyed successfully.
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lazy-loading 'resources' on Instance uuid 5d2440a0-860c-4700-9fed-224851bec304 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1207065891',display_name='tempest-VolumesAdminNegativeTest-server-1207065891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1207065891',id=10,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChSrArlyDyBzqE0UhpVHUqG8g7uIRb2KXcSzfBb8dWjE5kCJKLtHKiinEuPDCECKYhLhv0z8uKZpaSed5bUqGErXHTCnUAoXzp2gR9rpuS97KU2qs29zaVzFG5qWSJSpA==',key_name='tempest-keypair-188592589',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371ee6c1bd154750aa942c3b582d2bda',ramdisk_id='',reservation_id='r-3chme8oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1117550447',owner_user_name='tempest-VolumesAdminNegativeTest-1117550447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab6b6a50d274fdeb10da465b2b89eb9',uuid=5d2440a0-860c-4700-9fed-224851bec304,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converting VIF {"id": "294180fe-682a-4cae-89ad-834369b928a5", "address": "fa:16:3e:47:77:db", "network": {"id": "a5e9cea4-7398-49d4-901d-7a0314363610", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1343080280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371ee6c1bd154750aa942c3b582d2bda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294180fe-68", "ovs_interfaceid": "294180fe-682a-4cae-89ad-834369b928a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG os_vif [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap294180fe-68, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:42 user nova-compute[70994]: INFO os_vif [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:77:db,bridge_name='br-int',has_traffic_filtering=True,id=294180fe-682a-4cae-89ad-834369b928a5,network=Network(a5e9cea4-7398-49d4-901d-7a0314363610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294180fe-68')
Jul 27 12:45:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Deleting instance files /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304_del
Jul 27 12:45:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Deletion of /opt/stack/data/nova/instances/5d2440a0-860c-4700-9fed-224851bec304_del complete
Jul 27 12:45:42 user nova-compute[70994]: INFO nova.compute.manager [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 12:45:42 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:45:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:43 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:43 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Took 1.15 seconds to deallocate network for instance.
Jul 27 12:45:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-0a7624be-1dd9-4356-ab4a-3adf26e0e09e req-63557d83-011f-4d52-950f-6567e3a90f2e service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-deleted-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] Acquiring lock "5d2440a0-860c-4700-9fed-224851bec304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] Lock "5d2440a0-860c-4700-9fed-224851bec304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] No waiting events found dispatching network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:44 user nova-compute[70994]: WARNING nova.compute.manager [req-fd747006-5155-4a98-b6ab-0454e8d81fa3 req-0144859f-c187-4578-adec-b5b2d6c24346 service nova] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Received unexpected event network-vif-plugged-294180fe-682a-4cae-89ad-834369b928a5 for instance with vm_state deleted and task_state None.
Jul 27 12:45:44 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Deleted allocations for instance 5d2440a0-860c-4700-9fed-224851bec304
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:45:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd2e97e6-2f0f-434c-b277-69b1737bc1e5 tempest-VolumesAdminNegativeTest-1117550447 tempest-VolumesAdminNegativeTest-1117550447-project-member] Lock "5d2440a0-860c-4700-9fed-224851bec304" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.592s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:47 user nova-compute[70994]: INFO nova.compute.manager [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Unrescuing
Jul 27 12:45:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:45:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:45:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:45:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG nova.network.neutron [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'flavor' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:48 user nova-compute[70994]: WARNING nova.compute.manager [req-0ed943c1-d235-416b-95d2-e77716745443 req-6f792107-ce41-426c-9482-13bcd6df958f service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:45:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance destroyed successfully.
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:48 user nova-compute[70994]: INFO nova.compute.manager [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Terminating instance
Jul 27 12:45:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-5a62a791-a6cf-48b5-b2ad-02b435af682d req-ef3d0737-762d-4e03-b6b1-57ba0cab407f service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-unplugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Instance destroyed successfully.
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.objects.instance [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'resources' on Instance uuid 4a853286-11ba-4a34-824b-bc59b8a5ac50 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:50 user nova-compute[70994]: WARNING nova.compute.manager [req-22120fe3-7df8-4fb6-ba19-cc99719b6624 req-8150788d-a2a2-40eb-9a53-4aaf46215cb0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1544413435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1544413435',id=6,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHA/0ZdIUUbuXgXuYWyt8Ne9/98bA7k/UnTKqmwDW5XVpm4ojrYuM0B8LSBiW3zj3V03WTiJfa4aimiP/566c7Yds/L0cTgvtmWuKEOEfouSNK3EYYKsckqZy9YEHPmDQ==',key_name='tempest-keypair-1555823318',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-4f71le0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:43:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=4a853286-11ba-4a34-824b-bc59b8a5ac50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "address": "fa:16:3e:13:ab:63", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f23a04a-22", "ovs_interfaceid": "3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG os_vif [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f23a04a-22, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:50 user nova-compute[70994]: INFO os_vif [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f23a04a-22')
Jul 27 12:45:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Deleting instance files /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50_del
Jul 27 12:45:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Deletion of /opt/stack/data/nova/instances/4a853286-11ba-4a34-824b-bc59b8a5ac50_del complete
Jul 27 12:45:50 user nova-compute[70994]: INFO nova.compute.manager [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Took 1.55 seconds to destroy the instance on the hypervisor.
Jul 27 12:45:50 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:45:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:51 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Took 0.92 seconds to deallocate network for instance.
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-5bbb6e4f-a2d1-458f-875f-fe672175d94b req-75040124-8ddb-46ea-8a63-e3e0a3daf9ac service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-deleted-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:51 user nova-compute[70994]: INFO nova.compute.manager [req-5bbb6e4f-a2d1-458f-875f-fe672175d94b req-75040124-8ddb-46ea-8a63-e3e0a3daf9ac service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Neutron deleted interface 3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f; detaching it from the instance and deleting it from the info cache
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.network.neutron [req-5bbb6e4f-a2d1-458f-875f-fe672175d94b req-75040124-8ddb-46ea-8a63-e3e0a3daf9ac service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-5bbb6e4f-a2d1-458f-875f-fe672175d94b req-75040124-8ddb-46ea-8a63-e3e0a3daf9ac service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Detach interface failed, port_id=3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f, reason: Instance 4a853286-11ba-4a34-824b-bc59b8a5ac50 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] Acquiring lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] No waiting events found dispatching network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:51 user nova-compute[70994]: WARNING nova.compute.manager [req-21a2d8cd-873a-44eb-a882-8d0947babc72 req-aad6b4be-fd7b-431a-aea2-7c5fd28d8eb5 service nova] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Received unexpected event network-vif-plugged-3f23a04a-2222-4ea6-b4c9-fb9a5e8a261f for instance with vm_state deleted and task_state None.
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:52 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Deleted allocations for instance 4a853286-11ba-4a34-824b-bc59b8a5ac50
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-00f165be-2e7e-43c3-83a3-e769091857e2 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "4a853286-11ba-4a34-824b-bc59b8a5ac50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:52 user nova-compute[70994]: WARNING nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:45:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:45:52 user nova-compute[70994]: WARNING nova.compute.manager [req-d928fb43-6786-4850-abc4-c55fbc9b3cd5 req-cfafc856-9673-41ed-949a-0a245fe705f0 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:45:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461953.0260503, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:53 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Resumed (Lifecycle Event)
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-75ec08d3-b95d-4260-9e98-75285cac60ab tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:53 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690461953.0276675, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:53 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Started (Lifecycle Event)
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:45:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:45:57 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461942.452171, 5d2440a0-860c-4700-9fed-224851bec304 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:45:57 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 5d2440a0-860c-4700-9fed-224851bec304] VM Stopped (Lifecycle Event)
Jul 27 12:45:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-bee5dbe0-6274-4b98-9088-43fb9c194db4 None None] [instance: 5d2440a0-860c-4700-9fed-224851bec304] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:45:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:01 user nova-compute[70994]: INFO nova.compute.manager [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Terminating instance
Jul 27 12:46:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-unplugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] No waiting events found dispatching network-vif-unplugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-29d179d1-40ce-4f24-b811-7c7bb2e0f1a9 req-51b0aafe-2365-4ba3-aa29-f1dbdf1bb307 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-unplugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Instance destroyed successfully.
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lazy-loading 'resources' on Instance uuid 2e5e427a-a4a8-4a94-bae5-cde57b96959b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1668109159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1668109159',id=7,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG1fMtpuWv5B2HQ824g1AGTuy7NM/2AjeINuI0Lplb3OAuM+Z7m0KaESeZowkBYdz4tOdFVuz/JbJcv35qAJ8ub93X2Fly963wDRp9dnZaX5rNQwlvTfMdqpWPHzlzS5w==',key_name='tempest-keypair-389590009',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21bb670b38a14ac6a4583f39b7cfedb7',ramdisk_id='',reservation_id='r-706b902h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-771279538',owner_user_name='tempest-ServerActionsV293TestJSON-771279538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='549272be22b842818d896dd8e4f79132',uuid=2e5e427a-a4a8-4a94-bae5-cde57b96959b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converting VIF {"id": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "address": "fa:16:3e:dd:85:56", "network": {"id": "42b23047-c934-4f35-b096-23955a334276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1036580475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21bb670b38a14ac6a4583f39b7cfedb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5342fa4a-a6", "ovs_interfaceid": "5342fa4a-a64a-4af0-a4ba-8cf183415666", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG os_vif [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5342fa4a-a6, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:46:02 user nova-compute[70994]: INFO os_vif [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:85:56,bridge_name='br-int',has_traffic_filtering=True,id=5342fa4a-a64a-4af0-a4ba-8cf183415666,network=Network(42b23047-c934-4f35-b096-23955a334276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5342fa4a-a6')
Jul 27 12:46:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Deleting instance files /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b_del
Jul 27 12:46:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Deletion of /opt/stack/data/nova/instances/2e5e427a-a4a8-4a94-bae5-cde57b96959b_del complete
Jul 27 12:46:02 user nova-compute[70994]: INFO nova.compute.manager [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 12:46:02 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:46:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:03 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Took 0.99 seconds to deallocate network for instance.
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] Acquiring lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] No waiting events found dispatching network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:03 user nova-compute[70994]: WARNING nova.compute.manager [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received unexpected event network-vif-plugged-5342fa4a-a64a-4af0-a4ba-8cf183415666 for instance with vm_state deleted and task_state None.
Jul 27 12:46:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65a13600-0f56-4fe9-8f58-14ba85e371a3 req-ba7d1a1e-eac0-4b0a-ac48-69c88dd9de09 service nova] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Received event network-vif-deleted-5342fa4a-a64a-4af0-a4ba-8cf183415666 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:03 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Deleted allocations for instance 2e5e427a-a4a8-4a94-bae5-cde57b96959b
Jul 27 12:46:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3ff07e70-c407-46fc-921f-90124f7d2cbc tempest-ServerActionsV293TestJSON-771279538 tempest-ServerActionsV293TestJSON-771279538-project-member] Lock "2e5e427a-a4a8-4a94-bae5-cde57b96959b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:05 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461950.2992554, 4a853286-11ba-4a34-824b-bc59b8a5ac50 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:05 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] VM Stopped (Lifecycle Event)
Jul 27 12:46:05 user nova-compute[70994]: DEBUG nova.compute.manager [None req-51ebc110-33e2-4932-b8f8-742b1c8d8285 None None] [instance: 4a853286-11ba-4a34-824b-bc59b8a5ac50] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:15 user nova-compute[70994]: INFO nova.compute.manager [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Detaching volume d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:46:15 user nova-compute[70994]: INFO nova.virt.block_device [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Attempting to driver detach volume d8a4e71e-262b-499d-860a-c8d26b41c214 from mountpoint /dev/vdb
Jul 27 12:46:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Attempting to detach device vdb from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:46:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:46:15 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:46:15 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:46:15 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:46:15 user nova-compute[70994]:   <serial>d8a4e71e-262b-499d-860a-c8d26b41c214</serial>
Jul 27 12:46:15 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:46:15 user nova-compute[70994]: </disk>
Jul 27 12:46:15 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:15 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully detached device vdb from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the persistent domain config.
Jul 27 12:46:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:46:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:46:15 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:46:15 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:46:15 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:46:15 user nova-compute[70994]:   <serial>d8a4e71e-262b-499d-860a-c8d26b41c214</serial>
Jul 27 12:46:15 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:46:15 user nova-compute[70994]: </disk>
Jul 27 12:46:15 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690461976.1297402, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:46:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully detached device vdb from instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 from the live domain config.
Jul 27 12:46:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzLEZBAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:46:16 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1778d91-6611-4e28-aff8-c5335f316e2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:46:16 user nova-compute[70994]: No targets found.
Jul 27 12:46:16 user nova-compute[70994]: iSNS:
Jul 27 12:46:16 user nova-compute[70994]: No targets found.
Jul 27 12:46:16 user nova-compute[70994]: STATIC:
Jul 27 12:46:16 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214
Jul 27 12:46:16 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:46:16 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:46:16 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:46:16 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:46:16 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:46:16 user nova-compute[70994]: FIRMWARE:
Jul 27 12:46:16 user nova-compute[70994]: No targets found.
Jul 27 12:46:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:46:16 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:46:16 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb088b-3414-4a25-a1fd-ad5941bfc76c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6efc8-f5d3-43e6-9b1e-f92300c94313]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:16 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:46:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:16 user nova-compute[70994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 (non-flash)
Jul 27 12:46:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4315000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57779ea9-3bf4-475e-8b36-e5e3af33ed4b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d6c96-ebdf-427d-baf7-bc53c58f545e]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dabab13-6c2b-43b8-8494-81ec79b674ad]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6efa3-8b57-4cd2-9d59-f23e1bcb893b]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[39069cac-3e41-467b-9fe2-586b46e88d13]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db8be6-4b22-40da-8f87-d77f5eaa5fe5]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260]
Jul 27 12:46:16 user nova-compute[70994]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214, portal: 172.16.0.220,3260] successful.
Jul 27 12:46:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8a4e71e-262b-499d-860a-c8d26b41c214 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f031577-a1af-4960-a1ac-c02068d965a6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== disconnect_volume: return (273ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:46:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:46:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'flavor' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-999f688c-e391-4781-97da-254333b40338 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:17 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690461962.2341096, 2e5e427a-a4a8-4a94-bae5-cde57b96959b => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:17 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] VM Stopped (Lifecycle Event)
Jul 27 12:46:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6b7a1bdd-8532-461e-b609-e154249fc02c None None] [instance: 2e5e427a-a4a8-4a94-bae5-cde57b96959b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:46:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:28 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:46:28 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:46:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:40 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:46:40 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:46:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=25.551937103271484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 526e9d52-53e8-4c83-b147-08dbf52f6aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b4befc11-c528-4b29-bdd4-e3d0e9b82700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:46:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-changed-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.compute.manager [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing instance network info cache due to event network-changed-4fd073ea-1892-4d4b-be31-f770ebbc4312. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing network info cache for port 4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'pci_requests' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:42 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:46:43 user nova-compute[70994]: DEBUG nova.policy [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6732bc36ed624e9ea1464f56036ad866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b59d9a59094d3392ea26f8c280b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:46:43 user nova-compute[70994]: DEBUG nova.network.neutron [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updated VIF entry in instance network info cache for port 4fd073ea-1892-4d4b-be31-f770ebbc4312. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:46:43 user nova-compute[70994]: DEBUG nova.network.neutron [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b00ac9f4-181a-42ee-b8e7-d63b29c79520 req-81983546-cd62-403f-8dd2-5a01ea978d00 service nova] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Successfully created port: 5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:46:44 user nova-compute[70994]: INFO nova.compute.claims [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Claim successful on node user
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Successfully updated port: 5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-changed-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing instance network info cache due to event network-changed-5503c737-8b7d-487a-bfcd-11d652e512ef. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:46:44 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.policy [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0ba1f1c8b842c4b1067033391456ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0451def811f34a848fd1450763964b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:46:44 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Creating image(s)
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk 1073741824" returned: 0 in 0.053s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Refreshing network info cache for port 5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG os_vif [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5503c737-8b, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5503c737-8b, col_values=(('external_ids', {'iface-id': '5503c737-8b7d-487a-bfcd-11d652e512ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:d4:49', 'vm-uuid': '526e9d52-53e8-4c83-b147-08dbf52f6aff'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Cannot resize image /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'migration_context' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:45 user nova-compute[70994]: INFO os_vif [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b')
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] attach device xml: <interface type="ethernet">
Jul 27 12:46:45 user nova-compute[70994]:   <mac address="fa:16:3e:50:d4:49"/>
Jul 27 12:46:45 user nova-compute[70994]:   <model type="virtio"/>
Jul 27 12:46:45 user nova-compute[70994]:   <mtu size="1442"/>
Jul 27 12:46:45 user nova-compute[70994]:   <target dev="tap5503c737-8b"/>
Jul 27 12:46:45 user nova-compute[70994]: </interface>
Jul 27 12:46:45 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Ensure instance console log exists: /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name hda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No VIF found with MAC fa:16:3e:be:d6:51, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:46:45 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:46:45</nova:creationTime>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:46:45 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:46:45 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:owner>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:46:45 user nova-compute[70994]:   </nova:owner>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:46:45 user nova-compute[70994]:   <nova:ports>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:46:45 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:46:45 user nova-compute[70994]:     </nova:port>
Jul 27 12:46:45 user nova-compute[70994]:     <nova:port uuid="5503c737-8b7d-487a-bfcd-11d652e512ef">
Jul 27 12:46:45 user nova-compute[70994]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Jul 27 12:46:45 user nova-compute[70994]:     </nova:port>
Jul 27 12:46:45 user nova-compute[70994]:   </nova:ports>
Jul 27 12:46:45 user nova-compute[70994]: </nova:instance>
Jul 27 12:46:45 user nova-compute[70994]:  {{(pid=70994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:45 user nova-compute[70994]: WARNING nova.compute.manager [req-e0e650a3-b98d-47a8-b210-cf9686acd073 req-4ea87e43-6a2e-4275-ae18-d1367dd08796 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef for instance with vm_state active and task_state None.
Jul 27 12:46:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Successfully created port: d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:46:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1f99881b-7c75-450e-9a82-3c80a16317d7 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.329s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updated VIF entry in instance network info cache for port 5503c737-8b7d-487a-bfcd-11d652e512ef. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e5d7b26b-b928-4399-8c19-088e86890064 req-e9a11895-a1b9-48a3-91cf-baebb203a60e service nova] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG nova.objects.instance [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:46 user nova-compute[70994]: INFO nova.compute.manager [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Attaching volume 7410db4d-87eb-4ed1-8e79-adc3b2d8f20f to /dev/vdb
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.utils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32dc2ce-46de-48ec-a98f-50a1dea7bc8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca58d3-8daf-4e23-9117-71206899e168]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c8bc1-c568-4e5a-9539-0a4f71011838]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d264d09a-9ee6-41db-89ae-2b938f50e0d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:46:46 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:46:46 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617a88c-8916-4757-9ce9-f8e11e1682f8]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG os_brick.utils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating existing volume attachment record: 99930050-dfbe-4a88-8da5-af852adf6f90 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:46:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Successfully updated port: d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance network_info: |[{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start _get_guest_xml network_info=[{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:46:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:46:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8fiHOQb+lEJ5NUA0fNEH0ky8zAYxfDHFHtM8YUbsyNxEzIOdAk+tEYGZJU7rhlBemvGXf562vSJkaqPZ7ThpO/Brhtg2ISN6Zs/H9G1Ta9yOa/SDi2saFOggL4b5jKaQ==',key_name='tempest-keypair-268239023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.objects.instance [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_devices' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:46:47 user nova-compute[70994]:   <uuid>201a7ef6-4cc0-4e56-8559-52d524bafe16</uuid>
Jul 27 12:46:47 user nova-compute[70994]:   <name>instance-00000015</name>
Jul 27 12:46:47 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:46:47 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:46:47 user nova-compute[70994]:   <metadata>
Jul 27 12:46:47 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:46:47 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-621725393</nova:name>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:46:47</nova:creationTime>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:46:47 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:46:47 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:owner>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:user uuid="5a0ba1f1c8b842c4b1067033391456ab">tempest-AttachVolumeShelveTestJSON-1527010192-project-member</nova:user>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:project uuid="0451def811f34a848fd1450763964b49">tempest-AttachVolumeShelveTestJSON-1527010192</nova:project>
Jul 27 12:46:47 user nova-compute[70994]:       </nova:owner>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:46:47 user nova-compute[70994]:       <nova:ports>
Jul 27 12:46:47 user nova-compute[70994]:         <nova:port uuid="d6633dff-0d5e-416d-a53e-46659b9dbcce">
Jul 27 12:46:47 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:46:47 user nova-compute[70994]:         </nova:port>
Jul 27 12:46:47 user nova-compute[70994]:       </nova:ports>
Jul 27 12:46:47 user nova-compute[70994]:     </nova:instance>
Jul 27 12:46:47 user nova-compute[70994]:   </metadata>
Jul 27 12:46:47 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:46:47 user nova-compute[70994]:     <system>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="serial">201a7ef6-4cc0-4e56-8559-52d524bafe16</entry>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="uuid">201a7ef6-4cc0-4e56-8559-52d524bafe16</entry>
Jul 27 12:46:47 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:46:47 user nova-compute[70994]:     </system>
Jul 27 12:46:47 user nova-compute[70994]:   </sysinfo>
Jul 27 12:46:47 user nova-compute[70994]:   <os>
Jul 27 12:46:47 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:46:47 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:46:47 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:46:47 user nova-compute[70994]:   </os>
Jul 27 12:46:47 user nova-compute[70994]:   <features>
Jul 27 12:46:47 user nova-compute[70994]:     <acpi/>
Jul 27 12:46:47 user nova-compute[70994]:     <apic/>
Jul 27 12:46:47 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:46:47 user nova-compute[70994]:   </features>
Jul 27 12:46:47 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:46:47 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:46:47 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:46:47 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:46:47 user nova-compute[70994]:   </clock>
Jul 27 12:46:47 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:46:47 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:46:47 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:46:47 user nova-compute[70994]:   </cpu>
Jul 27 12:46:47 user nova-compute[70994]:   <devices>
Jul 27 12:46:47 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:46:47 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:46:47 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk"/>
Jul 27 12:46:47 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:46:47 user nova-compute[70994]:     </disk>
Jul 27 12:46:47 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:46:47 user nova-compute[70994]:       <mac address="fa:16:3e:f6:87:f5"/>
Jul 27 12:46:47 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:46:47 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:46:47 user nova-compute[70994]:       <target dev="tapd6633dff-0d"/>
Jul 27 12:46:47 user nova-compute[70994]:     </interface>
Jul 27 12:46:47 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:46:47 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/console.log" append="off"/>
Jul 27 12:46:47 user nova-compute[70994]:     </serial>
Jul 27 12:46:47 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:46:47 user nova-compute[70994]:     <video>
Jul 27 12:46:47 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:46:47 user nova-compute[70994]:     </video>
Jul 27 12:46:47 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:46:47 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:46:47 user nova-compute[70994]:     </rng>
Jul 27 12:46:47 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:46:47 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:46:47 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:46:47 user nova-compute[70994]:     </memballoon>
Jul 27 12:46:47 user nova-compute[70994]:   </devices>
Jul 27 12:46:47 user nova-compute[70994]: </domain>
Jul 27 12:46:47 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8fiHOQb+lEJ5NUA0fNEH0ky8zAYxfDHFHtM8YUbsyNxEzIOdAk+tEYGZJU7rhlBemvGXf562vSJkaqPZ7ThpO/Brhtg2ISN6Zs/H9G1Ta9yOa/SDi2saFOggL4b5jKaQ==',key_name='tempest-keypair-268239023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG os_vif [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6633dff-0d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6633dff-0d, col_values=(('external_ids', {'iface-id': 'd6633dff-0d5e-416d-a53e-46659b9dbcce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:87:f5', 'vm-uuid': '201a7ef6-4cc0-4e56-8559-52d524bafe16'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:47 user nova-compute[70994]: INFO os_vif [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d')
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:47 user nova-compute[70994]: WARNING nova.compute.manager [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef for instance with vm_state active and task_state None.
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing instance network info cache due to event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:46:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:46:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No VIF found with MAC fa:16:3e:f6:87:f5, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:46:48 user nova-compute[70994]: INFO nova.compute.manager [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Unrescuing
Jul 27 12:46:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:46:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:46:48 user nova-compute[70994]: DEBUG nova.network.neutron [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.network.neutron [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updated VIF entry in instance network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.network.neutron [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ca51c61d-cd29-46a6-92f9-c266e5dacf96 req-65183f9f-5f8d-496b-9bfd-e38830268720 service nova] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.network.neutron [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.objects.instance [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'flavor' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:49 user nova-compute[70994]: WARNING nova.compute.manager [req-d2e8e692-53d5-4e5c-971e-38999877c422 req-588274dc-4a17-4944-8ed3-71c581d068de service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state building and task_state spawning.
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:50 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance destroyed successfully.
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:51 user nova-compute[70994]: WARNING nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state building and task_state spawning.
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:51 user nova-compute[70994]: WARNING nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:51 user nova-compute[70994]: WARNING nova.compute.manager [req-d87e22ab-f580-4972-b6bf-84d266c4ed39 req-2a89e024-702b-43ab-bf41-b06c03a2297a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462011.794987, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Resumed (Lifecycle Event)
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:46:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance spawned successfully.
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:46:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462011.7961485, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Started (Lifecycle Event)
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:46:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:46:52 user nova-compute[70994]: INFO nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Took 7.27 seconds to spawn the instance on the hypervisor.
Jul 27 12:46:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:52 user nova-compute[70994]: INFO nova.compute.manager [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Took 8.01 seconds to build instance.
Jul 27 12:46:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-16d9d5af-e1b9-4cb2-813e-49a35c110f5b tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.118s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:53 user nova-compute[70994]: WARNING nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:46:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:46:53 user nova-compute[70994]: WARNING nova.compute.manager [req-892825ea-e879-4ae6-8703-7e7ce016d0a5 req-e8c2592a-fd15-424d-9c60-435ba6c99728 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for aa5113ca-9965-4138-af35-af69b50f9500 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462014.069428, aa5113ca-9965-4138-af35-af69b50f9500 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:54 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Resumed (Lifecycle Event)
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-efb90e1f-171c-4e8e-92ba-3c7a152dd1a5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:46:54 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462014.0695722, aa5113ca-9965-4138-af35-af69b50f9500 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:46:54 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Started (Lifecycle Event)
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHmUAZDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:46:54 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:46:54 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:46:54 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871e094-14b1-4da5-95c2-bd4de796c2ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:46:54 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f575d0-71ce-4b2a-88b0-02901afd1df6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f] added
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d6232-d350-4bc9-884f-176d4f17bacd]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a822f0a-d3f7-4b12-adec-68fbed10962e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHmUAZDP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHmUAZDP" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f10d7-7b65-4a65-8c63-47932625a4ca]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHmUAZDP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce95de-bcf9-4234-97f3-424bbaffdc35]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffebfec-0901-41fc-9207-cf5762a251f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc8741f-519f-4928-b37f-4f1c34d5912c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260]
Jul 27 12:46:54 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260] successful.
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3bca82-9d1c-4239-b2f9-4b35bdbc9a80]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a697de7-2278-41a7-9308-b448cd4d0b97]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:54 user nova-compute[70994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:54 user nova-compute[70994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)
Jul 27 12:46:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9919eab-973b-4df0-8e2f-698eb57c1da1]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHmUAZDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23033643135333962', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643135333962', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG nova.objects.instance [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:46:55 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:46:55 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:46:55 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:46:55 user nova-compute[70994]:   <serial>7410db4d-87eb-4ed1-8e79-adc3b2d8f20f</serial>
Jul 27 12:46:55 user nova-compute[70994]: </disk>
Jul 27 12:46:55 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:46:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:46:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No BDM found with device name hda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:46:56 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] No VIF found with MAC fa:16:3e:be:d6:51, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:46:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ca99857c-51cf-4474-9c53-ff6c2417e6b2 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.504s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:57 user nova-compute[70994]: INFO nova.compute.manager [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Detaching volume 7410db4d-87eb-4ed1-8e79-adc3b2d8f20f
Jul 27 12:46:57 user nova-compute[70994]: INFO nova.virt.block_device [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Attempting to driver detach volume 7410db4d-87eb-4ed1-8e79-adc3b2d8f20f from mountpoint /dev/vdb
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Attempting to detach device vdb from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:46:57 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:46:57 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:46:57 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:46:57 user nova-compute[70994]:   <serial>7410db4d-87eb-4ed1-8e79-adc3b2d8f20f</serial>
Jul 27 12:46:57 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 12:46:57 user nova-compute[70994]: </disk>
Jul 27 12:46:57 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully detached device vdb from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the persistent domain config.
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:46:57 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:46:57 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:46:57 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:46:57 user nova-compute[70994]:   <serial>7410db4d-87eb-4ed1-8e79-adc3b2d8f20f</serial>
Jul 27 12:46:57 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 12:46:57 user nova-compute[70994]: </disk>
Jul 27 12:46:57 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462017.833216, 526e9d52-53e8-4c83-b147-08dbf52f6aff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:46:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully detached device vdb from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the live domain config.
Jul 27 12:46:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHmUAZDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:46:57 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442c496-890b-4cdb-98d3-002270b3a498]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:46:57 user nova-compute[70994]: No targets found.
Jul 27 12:46:57 user nova-compute[70994]: iSNS:
Jul 27 12:46:57 user nova-compute[70994]: No targets found.
Jul 27 12:46:57 user nova-compute[70994]: STATIC:
Jul 27 12:46:57 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f
Jul 27 12:46:57 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:46:57 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:46:57 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:46:57 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:46:57 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:46:57 user nova-compute[70994]: FIRMWARE:
Jul 27 12:46:57 user nova-compute[70994]: No targets found.
Jul 27 12:46:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:46:57 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:46:57 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ec51fa-e59d-4889-af3d-346df8db104a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c235a5-7ca1-43fe-80e4-ea1d4c723e8a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:57 user nova-compute[70994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)
Jul 27 12:46:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:46:57 user nova-compute[70994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f (non-flash)
Jul 27 12:46:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8902852200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589c3c3-2f02-486c-927e-5062fba64740]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdcb52e-33eb-49b0-af4f-3eac84ebe90d]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:46:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f12c58-1e49-4e7f-b43d-15af7bb6c00c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d18a9-60d9-401d-829e-2db9dc632dcc]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c9c5a-0a43-4086-ad1d-2e22475ec42d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d55055-726d-49ca-847e-17dea4adf34c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260]
Jul 27 12:46:58 user nova-compute[70994]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f, portal: 172.16.0.220,3260] successful.
Jul 27 12:46:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7410db4d-87eb-4ed1-8e79-adc3b2d8f20f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e48f2-f24b-4dff-aefe-2406f654e166]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] <== disconnect_volume: return (356ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:46:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0c3bdfe4-fde7-4110-b6a9-55954e6236ea tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.953s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-5503c737-8b7d-487a-bfcd-11d652e512ef" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-5503c737-8b7d-487a-bfcd-11d652e512ef" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Attempting to detach device tap5503c737-8b from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] detach device xml: <interface type="ethernet">
Jul 27 12:46:59 user nova-compute[70994]:   <mac address="fa:16:3e:50:d4:49"/>
Jul 27 12:46:59 user nova-compute[70994]:   <model type="virtio"/>
Jul 27 12:46:59 user nova-compute[70994]:   <mtu size="1442"/>
Jul 27 12:46:59 user nova-compute[70994]:   <target dev="tap5503c737-8b"/>
Jul 27 12:46:59 user nova-compute[70994]: </interface>
Jul 27 12:46:59 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface>not found in domain: <domain type='kvm' id='24'>
Jul 27 12:46:59 user nova-compute[70994]:   <name>instance-00000013</name>
Jul 27 12:46:59 user nova-compute[70994]:   <uuid>526e9d52-53e8-4c83-b147-08dbf52f6aff</uuid>
Jul 27 12:46:59 user nova-compute[70994]:   <metadata>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:46:59 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:46:45</nova:creationTime>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:46:59 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:46:59 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:owner>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:46:59 user nova-compute[70994]:   </nova:owner>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:46:59 user nova-compute[70994]:   <nova:ports>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:46:59 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:46:59 user nova-compute[70994]:     </nova:port>
Jul 27 12:46:59 user nova-compute[70994]:     <nova:port uuid="5503c737-8b7d-487a-bfcd-11d652e512ef">
Jul 27 12:46:59 user nova-compute[70994]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Jul 27 12:46:59 user nova-compute[70994]:     </nova:port>
Jul 27 12:46:59 user nova-compute[70994]:   </nova:ports>
Jul 27 12:46:59 user nova-compute[70994]: </nova:instance>
Jul 27 12:46:59 user nova-compute[70994]:   </metadata>
Jul 27 12:46:59 user nova-compute[70994]:   <memory unit='KiB'>524288</memory>
Jul 27 12:46:59 user nova-compute[70994]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 12:46:59 user nova-compute[70994]:   <vcpu placement='static'>1</vcpu>
Jul 27 12:46:59 user nova-compute[70994]:   <resource>
Jul 27 12:46:59 user nova-compute[70994]:     <partition>/machine</partition>
Jul 27 12:46:59 user nova-compute[70994]:   </resource>
Jul 27 12:46:59 user nova-compute[70994]:   <sysinfo type='smbios'>
Jul 27 12:46:59 user nova-compute[70994]:     <system>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='version'>0.0.0</entry>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='serial'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='uuid'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:46:59 user nova-compute[70994]:       <entry name='family'>Virtual Machine</entry>
Jul 27 12:46:59 user nova-compute[70994]:     </system>
Jul 27 12:46:59 user nova-compute[70994]:   </sysinfo>
Jul 27 12:46:59 user nova-compute[70994]:   <os>
Jul 27 12:46:59 user nova-compute[70994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 12:46:59 user nova-compute[70994]:     <boot dev='hd'/>
Jul 27 12:46:59 user nova-compute[70994]:     <smbios mode='sysinfo'/>
Jul 27 12:46:59 user nova-compute[70994]:   </os>
Jul 27 12:46:59 user nova-compute[70994]:   <features>
Jul 27 12:46:59 user nova-compute[70994]:     <acpi/>
Jul 27 12:46:59 user nova-compute[70994]:     <apic/>
Jul 27 12:46:59 user nova-compute[70994]:     <vmcoreinfo state='on'/>
Jul 27 12:46:59 user nova-compute[70994]:   </features>
Jul 27 12:46:59 user nova-compute[70994]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 12:46:59 user nova-compute[70994]:     <model fallback='forbid'>Nehalem</model>
Jul 27 12:46:59 user nova-compute[70994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 12:46:59 user nova-compute[70994]:     <feature policy='require' name='vme'/>
Jul 27 12:46:59 user nova-compute[70994]:     <feature policy='require' name='x2apic'/>
Jul 27 12:46:59 user nova-compute[70994]:     <feature policy='require' name='hypervisor'/>
Jul 27 12:46:59 user nova-compute[70994]:   </cpu>
Jul 27 12:46:59 user nova-compute[70994]:   <clock offset='utc'>
Jul 27 12:46:59 user nova-compute[70994]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 12:46:59 user nova-compute[70994]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 12:46:59 user nova-compute[70994]:     <timer name='hpet' present='no'/>
Jul 27 12:46:59 user nova-compute[70994]:   </clock>
Jul 27 12:46:59 user nova-compute[70994]:   <on_poweroff>destroy</on_poweroff>
Jul 27 12:46:59 user nova-compute[70994]:   <on_reboot>restart</on_reboot>
Jul 27 12:46:59 user nova-compute[70994]:   <on_crash>destroy</on_crash>
Jul 27 12:46:59 user nova-compute[70994]:   <devices>
Jul 27 12:46:59 user nova-compute[70994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 12:46:59 user nova-compute[70994]:     <disk type='file' device='disk'>
Jul 27 12:46:59 user nova-compute[70994]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 12:46:59 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk' index='2'/>
Jul 27 12:46:59 user nova-compute[70994]:       <backingStore type='file' index='3'>
Jul 27 12:46:59 user nova-compute[70994]:         <format type='raw'/>
Jul 27 12:46:59 user nova-compute[70994]:         <source file='/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9'/>
Jul 27 12:46:59 user nova-compute[70994]:         <backingStore/>
Jul 27 12:46:59 user nova-compute[70994]:       </backingStore>
Jul 27 12:46:59 user nova-compute[70994]:       <target dev='vda' bus='virtio'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='virtio-disk0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </disk>
Jul 27 12:46:59 user nova-compute[70994]:     <disk type='file' device='cdrom'>
Jul 27 12:46:59 user nova-compute[70994]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 12:46:59 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config' index='1'/>
Jul 27 12:46:59 user nova-compute[70994]:       <backingStore/>
Jul 27 12:46:59 user nova-compute[70994]:       <target dev='hda' bus='ide'/>
Jul 27 12:46:59 user nova-compute[70994]:       <readonly/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='ide0-0-0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </disk>
Jul 27 12:46:59 user nova-compute[70994]:     <controller type='usb' index='0' model='none'>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='usb'/>
Jul 27 12:46:59 user nova-compute[70994]:     </controller>
Jul 27 12:46:59 user nova-compute[70994]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='pci.0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </controller>
Jul 27 12:46:59 user nova-compute[70994]:     <controller type='ide' index='0'>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='ide'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 12:46:59 user nova-compute[70994]:     </controller>
Jul 27 12:46:59 user nova-compute[70994]:     <interface type='ethernet'>
Jul 27 12:46:59 user nova-compute[70994]:       <mac address='fa:16:3e:be:d6:51'/>
Jul 27 12:46:59 user nova-compute[70994]:       <target dev='tap4fd073ea-18'/>
Jul 27 12:46:59 user nova-compute[70994]:       <model type='virtio'/>
Jul 27 12:46:59 user nova-compute[70994]:       <mtu size='1442'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='net0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </interface>
Jul 27 12:46:59 user nova-compute[70994]:     <interface type='ethernet'>
Jul 27 12:46:59 user nova-compute[70994]:       <mac address='fa:16:3e:50:d4:49'/>
Jul 27 12:46:59 user nova-compute[70994]:       <target dev='tap5503c737-8b'/>
Jul 27 12:46:59 user nova-compute[70994]:       <model type='virtio'/>
Jul 27 12:46:59 user nova-compute[70994]:       <mtu size='1442'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='net1'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </interface>
Jul 27 12:46:59 user nova-compute[70994]:     <serial type='pty'>
Jul 27 12:46:59 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:46:59 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:46:59 user nova-compute[70994]:       <target type='isa-serial' port='0'>
Jul 27 12:46:59 user nova-compute[70994]:         <model name='isa-serial'/>
Jul 27 12:46:59 user nova-compute[70994]:       </target>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </serial>
Jul 27 12:46:59 user nova-compute[70994]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 12:46:59 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:46:59 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:46:59 user nova-compute[70994]:       <target type='serial' port='0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </console>
Jul 27 12:46:59 user nova-compute[70994]:     <input type='mouse' bus='ps2'>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='input0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </input>
Jul 27 12:46:59 user nova-compute[70994]:     <input type='keyboard' bus='ps2'>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='input1'/>
Jul 27 12:46:59 user nova-compute[70994]:     </input>
Jul 27 12:46:59 user nova-compute[70994]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 27 12:46:59 user nova-compute[70994]:       <listen type='address' address='0.0.0.0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </graphics>
Jul 27 12:46:59 user nova-compute[70994]:     <audio id='1' type='none'/>
Jul 27 12:46:59 user nova-compute[70994]:     <video>
Jul 27 12:46:59 user nova-compute[70994]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='video0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </video>
Jul 27 12:46:59 user nova-compute[70994]:     <memballoon model='virtio'>
Jul 27 12:46:59 user nova-compute[70994]:       <stats period='10'/>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='balloon0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </memballoon>
Jul 27 12:46:59 user nova-compute[70994]:     <rng model='virtio'>
Jul 27 12:46:59 user nova-compute[70994]:       <backend model='random'>/dev/urandom</backend>
Jul 27 12:46:59 user nova-compute[70994]:       <alias name='rng0'/>
Jul 27 12:46:59 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 12:46:59 user nova-compute[70994]:     </rng>
Jul 27 12:46:59 user nova-compute[70994]:   </devices>
Jul 27 12:46:59 user nova-compute[70994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 12:46:59 user nova-compute[70994]:     <label>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</label>
Jul 27 12:46:59 user nova-compute[70994]:     <imagelabel>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</imagelabel>
Jul 27 12:46:59 user nova-compute[70994]:   </seclabel>
Jul 27 12:46:59 user nova-compute[70994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 12:46:59 user nova-compute[70994]:     <label>+64055:+108</label>
Jul 27 12:46:59 user nova-compute[70994]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 12:46:59 user nova-compute[70994]:   </seclabel>
Jul 27 12:46:59 user nova-compute[70994]: </domain>
Jul 27 12:46:59 user nova-compute[70994]:  {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 12:46:59 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully detached device tap5503c737-8b from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the persistent domain config.
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] (1/8): Attempting to detach device tap5503c737-8b with device alias net1 from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] detach device xml: <interface type="ethernet">
Jul 27 12:46:59 user nova-compute[70994]:   <mac address="fa:16:3e:50:d4:49"/>
Jul 27 12:46:59 user nova-compute[70994]:   <model type="virtio"/>
Jul 27 12:46:59 user nova-compute[70994]:   <mtu size="1442"/>
Jul 27 12:46:59 user nova-compute[70994]:   <target dev="tap5503c737-8b"/>
Jul 27 12:46:59 user nova-compute[70994]: </interface>
Jul 27 12:46:59 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:46:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462020.02374, 526e9d52-53e8-4c83-b147-08dbf52f6aff => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Start waiting for the detach event from libvirt for device tap5503c737-8b with device alias net1 for instance 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface>not found in domain: <domain type='kvm' id='24'>
Jul 27 12:47:00 user nova-compute[70994]:   <name>instance-00000013</name>
Jul 27 12:47:00 user nova-compute[70994]:   <uuid>526e9d52-53e8-4c83-b147-08dbf52f6aff</uuid>
Jul 27 12:47:00 user nova-compute[70994]:   <metadata>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:00 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:46:45</nova:creationTime>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:47:00 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:owner>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:owner>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:ports>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:47:00 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:00 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:port uuid="5503c737-8b7d-487a-bfcd-11d652e512ef">
Jul 27 12:47:00 user nova-compute[70994]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Jul 27 12:47:00 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:ports>
Jul 27 12:47:00 user nova-compute[70994]: </nova:instance>
Jul 27 12:47:00 user nova-compute[70994]:   </metadata>
Jul 27 12:47:00 user nova-compute[70994]:   <memory unit='KiB'>524288</memory>
Jul 27 12:47:00 user nova-compute[70994]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 12:47:00 user nova-compute[70994]:   <vcpu placement='static'>1</vcpu>
Jul 27 12:47:00 user nova-compute[70994]:   <resource>
Jul 27 12:47:00 user nova-compute[70994]:     <partition>/machine</partition>
Jul 27 12:47:00 user nova-compute[70994]:   </resource>
Jul 27 12:47:00 user nova-compute[70994]:   <sysinfo type='smbios'>
Jul 27 12:47:00 user nova-compute[70994]:     <system>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='version'>0.0.0</entry>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='serial'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='uuid'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:00 user nova-compute[70994]:       <entry name='family'>Virtual Machine</entry>
Jul 27 12:47:00 user nova-compute[70994]:     </system>
Jul 27 12:47:00 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:00 user nova-compute[70994]:   <os>
Jul 27 12:47:00 user nova-compute[70994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 12:47:00 user nova-compute[70994]:     <boot dev='hd'/>
Jul 27 12:47:00 user nova-compute[70994]:     <smbios mode='sysinfo'/>
Jul 27 12:47:00 user nova-compute[70994]:   </os>
Jul 27 12:47:00 user nova-compute[70994]:   <features>
Jul 27 12:47:00 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:00 user nova-compute[70994]:     <apic/>
Jul 27 12:47:00 user nova-compute[70994]:     <vmcoreinfo state='on'/>
Jul 27 12:47:00 user nova-compute[70994]:   </features>
Jul 27 12:47:00 user nova-compute[70994]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 12:47:00 user nova-compute[70994]:     <model fallback='forbid'>Nehalem</model>
Jul 27 12:47:00 user nova-compute[70994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 12:47:00 user nova-compute[70994]:     <feature policy='require' name='vme'/>
Jul 27 12:47:00 user nova-compute[70994]:     <feature policy='require' name='x2apic'/>
Jul 27 12:47:00 user nova-compute[70994]:     <feature policy='require' name='hypervisor'/>
Jul 27 12:47:00 user nova-compute[70994]:   </cpu>
Jul 27 12:47:00 user nova-compute[70994]:   <clock offset='utc'>
Jul 27 12:47:00 user nova-compute[70994]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 12:47:00 user nova-compute[70994]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 12:47:00 user nova-compute[70994]:     <timer name='hpet' present='no'/>
Jul 27 12:47:00 user nova-compute[70994]:   </clock>
Jul 27 12:47:00 user nova-compute[70994]:   <on_poweroff>destroy</on_poweroff>
Jul 27 12:47:00 user nova-compute[70994]:   <on_reboot>restart</on_reboot>
Jul 27 12:47:00 user nova-compute[70994]:   <on_crash>destroy</on_crash>
Jul 27 12:47:00 user nova-compute[70994]:   <devices>
Jul 27 12:47:00 user nova-compute[70994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 12:47:00 user nova-compute[70994]:     <disk type='file' device='disk'>
Jul 27 12:47:00 user nova-compute[70994]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 12:47:00 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk' index='2'/>
Jul 27 12:47:00 user nova-compute[70994]:       <backingStore type='file' index='3'>
Jul 27 12:47:00 user nova-compute[70994]:         <format type='raw'/>
Jul 27 12:47:00 user nova-compute[70994]:         <source file='/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9'/>
Jul 27 12:47:00 user nova-compute[70994]:         <backingStore/>
Jul 27 12:47:00 user nova-compute[70994]:       </backingStore>
Jul 27 12:47:00 user nova-compute[70994]:       <target dev='vda' bus='virtio'/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='virtio-disk0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </disk>
Jul 27 12:47:00 user nova-compute[70994]:     <disk type='file' device='cdrom'>
Jul 27 12:47:00 user nova-compute[70994]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 12:47:00 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config' index='1'/>
Jul 27 12:47:00 user nova-compute[70994]:       <backingStore/>
Jul 27 12:47:00 user nova-compute[70994]:       <target dev='hda' bus='ide'/>
Jul 27 12:47:00 user nova-compute[70994]:       <readonly/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='ide0-0-0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </disk>
Jul 27 12:47:00 user nova-compute[70994]:     <controller type='usb' index='0' model='none'>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='usb'/>
Jul 27 12:47:00 user nova-compute[70994]:     </controller>
Jul 27 12:47:00 user nova-compute[70994]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='pci.0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </controller>
Jul 27 12:47:00 user nova-compute[70994]:     <controller type='ide' index='0'>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='ide'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 12:47:00 user nova-compute[70994]:     </controller>
Jul 27 12:47:00 user nova-compute[70994]:     <interface type='ethernet'>
Jul 27 12:47:00 user nova-compute[70994]:       <mac address='fa:16:3e:be:d6:51'/>
Jul 27 12:47:00 user nova-compute[70994]:       <target dev='tap4fd073ea-18'/>
Jul 27 12:47:00 user nova-compute[70994]:       <model type='virtio'/>
Jul 27 12:47:00 user nova-compute[70994]:       <mtu size='1442'/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='net0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </interface>
Jul 27 12:47:00 user nova-compute[70994]:     <serial type='pty'>
Jul 27 12:47:00 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:00 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:00 user nova-compute[70994]:       <target type='isa-serial' port='0'>
Jul 27 12:47:00 user nova-compute[70994]:         <model name='isa-serial'/>
Jul 27 12:47:00 user nova-compute[70994]:       </target>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </serial>
Jul 27 12:47:00 user nova-compute[70994]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 12:47:00 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:00 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:00 user nova-compute[70994]:       <target type='serial' port='0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </console>
Jul 27 12:47:00 user nova-compute[70994]:     <input type='mouse' bus='ps2'>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='input0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </input>
Jul 27 12:47:00 user nova-compute[70994]:     <input type='keyboard' bus='ps2'>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='input1'/>
Jul 27 12:47:00 user nova-compute[70994]:     </input>
Jul 27 12:47:00 user nova-compute[70994]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 27 12:47:00 user nova-compute[70994]:       <listen type='address' address='0.0.0.0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </graphics>
Jul 27 12:47:00 user nova-compute[70994]:     <audio id='1' type='none'/>
Jul 27 12:47:00 user nova-compute[70994]:     <video>
Jul 27 12:47:00 user nova-compute[70994]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='video0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </video>
Jul 27 12:47:00 user nova-compute[70994]:     <memballoon model='virtio'>
Jul 27 12:47:00 user nova-compute[70994]:       <stats period='10'/>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='balloon0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:00 user nova-compute[70994]:     <rng model='virtio'>
Jul 27 12:47:00 user nova-compute[70994]:       <backend model='random'>/dev/urandom</backend>
Jul 27 12:47:00 user nova-compute[70994]:       <alias name='rng0'/>
Jul 27 12:47:00 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 12:47:00 user nova-compute[70994]:     </rng>
Jul 27 12:47:00 user nova-compute[70994]:   </devices>
Jul 27 12:47:00 user nova-compute[70994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 12:47:00 user nova-compute[70994]:     <label>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</label>
Jul 27 12:47:00 user nova-compute[70994]:     <imagelabel>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</imagelabel>
Jul 27 12:47:00 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:00 user nova-compute[70994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 12:47:00 user nova-compute[70994]:     <label>+64055:+108</label>
Jul 27 12:47:00 user nova-compute[70994]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 12:47:00 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:00 user nova-compute[70994]: </domain>
Jul 27 12:47:00 user nova-compute[70994]:  {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 12:47:00 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully detached device tap5503c737-8b from instance 526e9d52-53e8-4c83-b147-08dbf52f6aff from the live domain config.
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG os_vif [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5503c737-8b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:00 user nova-compute[70994]: INFO os_vif [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b')
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:00 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:47:00</nova:creationTime>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:47:00 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:owner>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:owner>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:00 user nova-compute[70994]:   <nova:ports>
Jul 27 12:47:00 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:47:00 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:00 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:00 user nova-compute[70994]:   </nova:ports>
Jul 27 12:47:00 user nova-compute[70994]: </nova:instance>
Jul 27 12:47:00 user nova-compute[70994]:  {{(pid=70994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-unplugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-unplugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:00 user nova-compute[70994]: WARNING nova.compute.manager [req-1a0bb5d4-17e3-4d2f-b7db-101d78149f79 req-10c829dc-8958-4dd0-a70a-30fbdad01038 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-unplugged-5503c737-8b7d-487a-bfcd-11d652e512ef for instance with vm_state active and task_state None.
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-deleted-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:01 user nova-compute[70994]: INFO nova.compute.manager [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Neutron deleted interface 5503c737-8b7d-487a-bfcd-11d652e512ef; detaching it from the instance and deleting it from the info cache
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.neutron [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquired lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.objects.instance [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Lazy-loading 'system_metadata' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.objects.instance [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Lazy-loading 'flavor' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface>not found in domain: <domain type='kvm' id='24'>
Jul 27 12:47:01 user nova-compute[70994]:   <name>instance-00000013</name>
Jul 27 12:47:01 user nova-compute[70994]:   <uuid>526e9d52-53e8-4c83-b147-08dbf52f6aff</uuid>
Jul 27 12:47:01 user nova-compute[70994]:   <metadata>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:01 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:47:00</nova:creationTime>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:47:01 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:ports>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:47:01 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:01 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:ports>
Jul 27 12:47:01 user nova-compute[70994]: </nova:instance>
Jul 27 12:47:01 user nova-compute[70994]:   </metadata>
Jul 27 12:47:01 user nova-compute[70994]:   <memory unit='KiB'>524288</memory>
Jul 27 12:47:01 user nova-compute[70994]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 12:47:01 user nova-compute[70994]:   <vcpu placement='static'>1</vcpu>
Jul 27 12:47:01 user nova-compute[70994]:   <resource>
Jul 27 12:47:01 user nova-compute[70994]:     <partition>/machine</partition>
Jul 27 12:47:01 user nova-compute[70994]:   </resource>
Jul 27 12:47:01 user nova-compute[70994]:   <sysinfo type='smbios'>
Jul 27 12:47:01 user nova-compute[70994]:     <system>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='version'>0.0.0</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='serial'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='uuid'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='family'>Virtual Machine</entry>
Jul 27 12:47:01 user nova-compute[70994]:     </system>
Jul 27 12:47:01 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:01 user nova-compute[70994]:   <os>
Jul 27 12:47:01 user nova-compute[70994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 12:47:01 user nova-compute[70994]:     <boot dev='hd'/>
Jul 27 12:47:01 user nova-compute[70994]:     <smbios mode='sysinfo'/>
Jul 27 12:47:01 user nova-compute[70994]:   </os>
Jul 27 12:47:01 user nova-compute[70994]:   <features>
Jul 27 12:47:01 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:01 user nova-compute[70994]:     <apic/>
Jul 27 12:47:01 user nova-compute[70994]:     <vmcoreinfo state='on'/>
Jul 27 12:47:01 user nova-compute[70994]:   </features>
Jul 27 12:47:01 user nova-compute[70994]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 12:47:01 user nova-compute[70994]:     <model fallback='forbid'>Nehalem</model>
Jul 27 12:47:01 user nova-compute[70994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='vme'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='x2apic'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='hypervisor'/>
Jul 27 12:47:01 user nova-compute[70994]:   </cpu>
Jul 27 12:47:01 user nova-compute[70994]:   <clock offset='utc'>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='hpet' present='no'/>
Jul 27 12:47:01 user nova-compute[70994]:   </clock>
Jul 27 12:47:01 user nova-compute[70994]:   <on_poweroff>destroy</on_poweroff>
Jul 27 12:47:01 user nova-compute[70994]:   <on_reboot>restart</on_reboot>
Jul 27 12:47:01 user nova-compute[70994]:   <on_crash>destroy</on_crash>
Jul 27 12:47:01 user nova-compute[70994]:   <devices>
Jul 27 12:47:01 user nova-compute[70994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 12:47:01 user nova-compute[70994]:     <disk type='file' device='disk'>
Jul 27 12:47:01 user nova-compute[70994]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 12:47:01 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk' index='2'/>
Jul 27 12:47:01 user nova-compute[70994]:       <backingStore type='file' index='3'>
Jul 27 12:47:01 user nova-compute[70994]:         <format type='raw'/>
Jul 27 12:47:01 user nova-compute[70994]:         <source file='/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9'/>
Jul 27 12:47:01 user nova-compute[70994]:         <backingStore/>
Jul 27 12:47:01 user nova-compute[70994]:       </backingStore>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='vda' bus='virtio'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='virtio-disk0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </disk>
Jul 27 12:47:01 user nova-compute[70994]:     <disk type='file' device='cdrom'>
Jul 27 12:47:01 user nova-compute[70994]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 12:47:01 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config' index='1'/>
Jul 27 12:47:01 user nova-compute[70994]:       <backingStore/>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='hda' bus='ide'/>
Jul 27 12:47:01 user nova-compute[70994]:       <readonly/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='ide0-0-0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </disk>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='usb' index='0' model='none'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='usb'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='pci.0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='ide' index='0'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='ide'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <interface type='ethernet'>
Jul 27 12:47:01 user nova-compute[70994]:       <mac address='fa:16:3e:be:d6:51'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='tap4fd073ea-18'/>
Jul 27 12:47:01 user nova-compute[70994]:       <model type='virtio'/>
Jul 27 12:47:01 user nova-compute[70994]:       <mtu size='1442'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='net0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </interface>
Jul 27 12:47:01 user nova-compute[70994]:     <serial type='pty'>
Jul 27 12:47:01 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:01 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target type='isa-serial' port='0'>
Jul 27 12:47:01 user nova-compute[70994]:         <model name='isa-serial'/>
Jul 27 12:47:01 user nova-compute[70994]:       </target>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </serial>
Jul 27 12:47:01 user nova-compute[70994]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 12:47:01 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:01 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target type='serial' port='0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </console>
Jul 27 12:47:01 user nova-compute[70994]:     <input type='mouse' bus='ps2'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='input0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </input>
Jul 27 12:47:01 user nova-compute[70994]:     <input type='keyboard' bus='ps2'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='input1'/>
Jul 27 12:47:01 user nova-compute[70994]:     </input>
Jul 27 12:47:01 user nova-compute[70994]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 27 12:47:01 user nova-compute[70994]:       <listen type='address' address='0.0.0.0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </graphics>
Jul 27 12:47:01 user nova-compute[70994]:     <audio id='1' type='none'/>
Jul 27 12:47:01 user nova-compute[70994]:     <video>
Jul 27 12:47:01 user nova-compute[70994]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='video0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </video>
Jul 27 12:47:01 user nova-compute[70994]:     <memballoon model='virtio'>
Jul 27 12:47:01 user nova-compute[70994]:       <stats period='10'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='balloon0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:01 user nova-compute[70994]:     <rng model='virtio'>
Jul 27 12:47:01 user nova-compute[70994]:       <backend model='random'>/dev/urandom</backend>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='rng0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </rng>
Jul 27 12:47:01 user nova-compute[70994]:   </devices>
Jul 27 12:47:01 user nova-compute[70994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 12:47:01 user nova-compute[70994]:     <label>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</label>
Jul 27 12:47:01 user nova-compute[70994]:     <imagelabel>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</imagelabel>
Jul 27 12:47:01 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:01 user nova-compute[70994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 12:47:01 user nova-compute[70994]:     <label>+64055:+108</label>
Jul 27 12:47:01 user nova-compute[70994]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 12:47:01 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:01 user nova-compute[70994]: </domain>
Jul 27 12:47:01 user nova-compute[70994]:  {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface> {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:d4:49"/><model type="virtio"/><mtu size="1442"/><target dev="tap5503c737-8b"/></interface>not found in domain: <domain type='kvm' id='24'>
Jul 27 12:47:01 user nova-compute[70994]:   <name>instance-00000013</name>
Jul 27 12:47:01 user nova-compute[70994]:   <uuid>526e9d52-53e8-4c83-b147-08dbf52f6aff</uuid>
Jul 27 12:47:01 user nova-compute[70994]:   <metadata>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:01 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:47:00</nova:creationTime>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:47:01 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:ports>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:47:01 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:01 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:ports>
Jul 27 12:47:01 user nova-compute[70994]: </nova:instance>
Jul 27 12:47:01 user nova-compute[70994]:   </metadata>
Jul 27 12:47:01 user nova-compute[70994]:   <memory unit='KiB'>524288</memory>
Jul 27 12:47:01 user nova-compute[70994]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 12:47:01 user nova-compute[70994]:   <vcpu placement='static'>1</vcpu>
Jul 27 12:47:01 user nova-compute[70994]:   <resource>
Jul 27 12:47:01 user nova-compute[70994]:     <partition>/machine</partition>
Jul 27 12:47:01 user nova-compute[70994]:   </resource>
Jul 27 12:47:01 user nova-compute[70994]:   <sysinfo type='smbios'>
Jul 27 12:47:01 user nova-compute[70994]:     <system>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='version'>0.0.0</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='serial'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='uuid'>526e9d52-53e8-4c83-b147-08dbf52f6aff</entry>
Jul 27 12:47:01 user nova-compute[70994]:       <entry name='family'>Virtual Machine</entry>
Jul 27 12:47:01 user nova-compute[70994]:     </system>
Jul 27 12:47:01 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:01 user nova-compute[70994]:   <os>
Jul 27 12:47:01 user nova-compute[70994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 12:47:01 user nova-compute[70994]:     <boot dev='hd'/>
Jul 27 12:47:01 user nova-compute[70994]:     <smbios mode='sysinfo'/>
Jul 27 12:47:01 user nova-compute[70994]:   </os>
Jul 27 12:47:01 user nova-compute[70994]:   <features>
Jul 27 12:47:01 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:01 user nova-compute[70994]:     <apic/>
Jul 27 12:47:01 user nova-compute[70994]:     <vmcoreinfo state='on'/>
Jul 27 12:47:01 user nova-compute[70994]:   </features>
Jul 27 12:47:01 user nova-compute[70994]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 12:47:01 user nova-compute[70994]:     <model fallback='forbid'>Nehalem</model>
Jul 27 12:47:01 user nova-compute[70994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='vme'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='x2apic'/>
Jul 27 12:47:01 user nova-compute[70994]:     <feature policy='require' name='hypervisor'/>
Jul 27 12:47:01 user nova-compute[70994]:   </cpu>
Jul 27 12:47:01 user nova-compute[70994]:   <clock offset='utc'>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 12:47:01 user nova-compute[70994]:     <timer name='hpet' present='no'/>
Jul 27 12:47:01 user nova-compute[70994]:   </clock>
Jul 27 12:47:01 user nova-compute[70994]:   <on_poweroff>destroy</on_poweroff>
Jul 27 12:47:01 user nova-compute[70994]:   <on_reboot>restart</on_reboot>
Jul 27 12:47:01 user nova-compute[70994]:   <on_crash>destroy</on_crash>
Jul 27 12:47:01 user nova-compute[70994]:   <devices>
Jul 27 12:47:01 user nova-compute[70994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 12:47:01 user nova-compute[70994]:     <disk type='file' device='disk'>
Jul 27 12:47:01 user nova-compute[70994]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 12:47:01 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk' index='2'/>
Jul 27 12:47:01 user nova-compute[70994]:       <backingStore type='file' index='3'>
Jul 27 12:47:01 user nova-compute[70994]:         <format type='raw'/>
Jul 27 12:47:01 user nova-compute[70994]:         <source file='/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9'/>
Jul 27 12:47:01 user nova-compute[70994]:         <backingStore/>
Jul 27 12:47:01 user nova-compute[70994]:       </backingStore>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='vda' bus='virtio'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='virtio-disk0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </disk>
Jul 27 12:47:01 user nova-compute[70994]:     <disk type='file' device='cdrom'>
Jul 27 12:47:01 user nova-compute[70994]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 12:47:01 user nova-compute[70994]:       <source file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk.config' index='1'/>
Jul 27 12:47:01 user nova-compute[70994]:       <backingStore/>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='hda' bus='ide'/>
Jul 27 12:47:01 user nova-compute[70994]:       <readonly/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='ide0-0-0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </disk>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='usb' index='0' model='none'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='usb'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='pci.0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <controller type='ide' index='0'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='ide'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 12:47:01 user nova-compute[70994]:     </controller>
Jul 27 12:47:01 user nova-compute[70994]:     <interface type='ethernet'>
Jul 27 12:47:01 user nova-compute[70994]:       <mac address='fa:16:3e:be:d6:51'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target dev='tap4fd073ea-18'/>
Jul 27 12:47:01 user nova-compute[70994]:       <model type='virtio'/>
Jul 27 12:47:01 user nova-compute[70994]:       <mtu size='1442'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='net0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </interface>
Jul 27 12:47:01 user nova-compute[70994]:     <serial type='pty'>
Jul 27 12:47:01 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:01 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target type='isa-serial' port='0'>
Jul 27 12:47:01 user nova-compute[70994]:         <model name='isa-serial'/>
Jul 27 12:47:01 user nova-compute[70994]:       </target>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </serial>
Jul 27 12:47:01 user nova-compute[70994]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 12:47:01 user nova-compute[70994]:       <source path='/dev/pts/7'/>
Jul 27 12:47:01 user nova-compute[70994]:       <log file='/opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/console.log' append='off'/>
Jul 27 12:47:01 user nova-compute[70994]:       <target type='serial' port='0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='serial0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </console>
Jul 27 12:47:01 user nova-compute[70994]:     <input type='mouse' bus='ps2'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='input0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </input>
Jul 27 12:47:01 user nova-compute[70994]:     <input type='keyboard' bus='ps2'>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='input1'/>
Jul 27 12:47:01 user nova-compute[70994]:     </input>
Jul 27 12:47:01 user nova-compute[70994]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 27 12:47:01 user nova-compute[70994]:       <listen type='address' address='0.0.0.0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </graphics>
Jul 27 12:47:01 user nova-compute[70994]:     <audio id='1' type='none'/>
Jul 27 12:47:01 user nova-compute[70994]:     <video>
Jul 27 12:47:01 user nova-compute[70994]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='video0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </video>
Jul 27 12:47:01 user nova-compute[70994]:     <memballoon model='virtio'>
Jul 27 12:47:01 user nova-compute[70994]:       <stats period='10'/>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='balloon0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:01 user nova-compute[70994]:     <rng model='virtio'>
Jul 27 12:47:01 user nova-compute[70994]:       <backend model='random'>/dev/urandom</backend>
Jul 27 12:47:01 user nova-compute[70994]:       <alias name='rng0'/>
Jul 27 12:47:01 user nova-compute[70994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 12:47:01 user nova-compute[70994]:     </rng>
Jul 27 12:47:01 user nova-compute[70994]:   </devices>
Jul 27 12:47:01 user nova-compute[70994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 12:47:01 user nova-compute[70994]:     <label>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</label>
Jul 27 12:47:01 user nova-compute[70994]:     <imagelabel>libvirt-526e9d52-53e8-4c83-b147-08dbf52f6aff</imagelabel>
Jul 27 12:47:01 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:01 user nova-compute[70994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 12:47:01 user nova-compute[70994]:     <label>+64055:+108</label>
Jul 27 12:47:01 user nova-compute[70994]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 12:47:01 user nova-compute[70994]:   </seclabel>
Jul 27 12:47:01 user nova-compute[70994]: </domain>
Jul 27 12:47:01 user nova-compute[70994]:  {{(pid=70994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 12:47:01 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Detaching interface fa:16:3e:50:d4:49 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap5503c737-8b' not found.
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Converting VIF {"id": "5503c737-8b7d-487a-bfcd-11d652e512ef", "address": "fa:16:3e:50:d4:49", "network": {"id": "ee088906-4522-4730-b2a3-93557d4d8d3e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1609829540", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5503c737-8b", "ovs_interfaceid": "5503c737-8b7d-487a-bfcd-11d652e512ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG os_vif [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5503c737-8b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:47:01 user nova-compute[70994]: INFO os_vif [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:d4:49,bridge_name='br-int',has_traffic_filtering=True,id=5503c737-8b7d-487a-bfcd-11d652e512ef,network=Network(ee088906-4522-4730-b2a3-93557d4d8d3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5503c737-8b')
Jul 27 12:47:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [req-8911a50b-0137-43fa-b194-6bff7410cb1a req-ee5be9ec-09b5-43ad-b753-c28723a085af service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:01 user nova-compute[70994]:   <nova:package version="0.0.0"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:name>tempest-device-tagging-server-2034990454</nova:name>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:creationTime>2023-07-27 12:47:01</nova:creationTime>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:flavor name="m1.tiny">
Jul 27 12:47:01 user nova-compute[70994]:     <nova:memory>512</nova:memory>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:disk>1</nova:disk>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:swap>0</nova:swap>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:flavor>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:user uuid="6732bc36ed624e9ea1464f56036ad866">tempest-TaggedAttachmentsTest-445980369-project-member</nova:user>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:project uuid="51b59d9a59094d3392ea26f8c280b61e">tempest-TaggedAttachmentsTest-445980369</nova:project>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:owner>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:01 user nova-compute[70994]:   <nova:ports>
Jul 27 12:47:01 user nova-compute[70994]:     <nova:port uuid="4fd073ea-1892-4d4b-be31-f770ebbc4312">
Jul 27 12:47:01 user nova-compute[70994]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:01 user nova-compute[70994]:     </nova:port>
Jul 27 12:47:01 user nova-compute[70994]:   </nova:ports>
Jul 27 12:47:01 user nova-compute[70994]: </nova:instance>
Jul 27 12:47:01 user nova-compute[70994]:  {{(pid=70994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 12:47:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:02 user nova-compute[70994]: WARNING nova.compute.manager [req-f7ca4705-1272-4e03-bce0-4dfee432456b req-8e9920e4-1c66-4ccf-bf25-c38bdb59b1e7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-5503c737-8b7d-487a-bfcd-11d652e512ef for instance with vm_state active and task_state None.
Jul 27 12:47:02 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [{"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Releasing lock "refresh_cache-526e9d52-53e8-4c83-b147-08dbf52f6aff" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5cdf85b-acaf-4793-b94b-28520b0c6ad1 tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "interface-526e9d52-53e8-4c83-b147-08dbf52f6aff-5503c737-8b7d-487a-bfcd-11d652e512ef" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.928s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'flavor' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:08 user nova-compute[70994]: INFO nova.compute.manager [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Attaching volume a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad to /dev/vdb
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3cb0f-1e95-4376-9d9a-a3c1c0913391]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f3734-7471-4fe6-afd6-efe13fdc827a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8188bc33-8548-4c51-8374-67a9884ce4d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa19ec3-51d1-403f-98cb-a1b1a261e3f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:47:08 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:47:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86815ad7-0e2c-416b-a5a0-f0c5b9a6d2bf]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:47:08 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating existing volume attachment record: 4fb97b99-2374-479d-91cb-7c306ab96d67 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:09 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:47:09 user nova-compute[70994]: INFO nova.compute.claims [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Claim successful on node user
Jul 27 12:47:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:47:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.policy [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f8edd1555a642b8b776aa6d329a1eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf2ec7ac6ff456eb3ef1f52241a742e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:47:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Creating image(s)
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk 1073741824" returned: 0 in 0.049s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:47:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Cannot resize image /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'migration_context' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Ensure instance console log exists: /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Successfully created port: 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Successfully updated port: 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing instance network info cache due to event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance network_info: |[{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.neutron [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start _get_guest_xml network_info=[{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:47:12 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:12 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1006968374',display_name='tempest-ServerStableDeviceRescueTest-server-1006968374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1006968374',id=22,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9cAQdEUwCjJ5NO/sU7pixKf7Ep1zH+79GJq+9pKHMOmoNI5F/OrHSlARsbOP9FjCl/CzuGGo0+IHt60ofxd4AqnC0785A6FFyW+GyYs7Je9M0sRHs9yyg058u3CDXiMQ==',key_name='tempest-keypair-1267023795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf2ec7ac6ff456eb3ef1f52241a742e',ramdisk_id='',reservation_id='r-d3aagtse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-373928889',owner_user_name='tempest-ServerStableDeviceRescueTest-373928889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f8edd1555a642b8b776aa6d329a1eaa',uuid=f9432eac-732b-4dcc-b8af-abb390b7cb55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converting VIF {"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'pci_devices' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:47:12 user nova-compute[70994]:   <uuid>f9432eac-732b-4dcc-b8af-abb390b7cb55</uuid>
Jul 27 12:47:12 user nova-compute[70994]:   <name>instance-00000016</name>
Jul 27 12:47:12 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:47:12 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:47:12 user nova-compute[70994]:   <metadata>
Jul 27 12:47:12 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:12 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1006968374</nova:name>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:47:12</nova:creationTime>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:47:12 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:12 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:owner>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:user uuid="4f8edd1555a642b8b776aa6d329a1eaa">tempest-ServerStableDeviceRescueTest-373928889-project-member</nova:user>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:project uuid="1bf2ec7ac6ff456eb3ef1f52241a742e">tempest-ServerStableDeviceRescueTest-373928889</nova:project>
Jul 27 12:47:12 user nova-compute[70994]:       </nova:owner>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:12 user nova-compute[70994]:       <nova:ports>
Jul 27 12:47:12 user nova-compute[70994]:         <nova:port uuid="33013b4d-599e-46b0-9f2d-446217b3e442">
Jul 27 12:47:12 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:47:12 user nova-compute[70994]:         </nova:port>
Jul 27 12:47:12 user nova-compute[70994]:       </nova:ports>
Jul 27 12:47:12 user nova-compute[70994]:     </nova:instance>
Jul 27 12:47:12 user nova-compute[70994]:   </metadata>
Jul 27 12:47:12 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:47:12 user nova-compute[70994]:     <system>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="serial">f9432eac-732b-4dcc-b8af-abb390b7cb55</entry>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="uuid">f9432eac-732b-4dcc-b8af-abb390b7cb55</entry>
Jul 27 12:47:12 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:47:12 user nova-compute[70994]:     </system>
Jul 27 12:47:12 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:12 user nova-compute[70994]:   <os>
Jul 27 12:47:12 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:47:12 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:47:12 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:47:12 user nova-compute[70994]:   </os>
Jul 27 12:47:12 user nova-compute[70994]:   <features>
Jul 27 12:47:12 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:12 user nova-compute[70994]:     <apic/>
Jul 27 12:47:12 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:47:12 user nova-compute[70994]:   </features>
Jul 27 12:47:12 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:47:12 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:47:12 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:47:12 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:47:12 user nova-compute[70994]:   </clock>
Jul 27 12:47:12 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:47:12 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:47:12 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:47:12 user nova-compute[70994]:   </cpu>
Jul 27 12:47:12 user nova-compute[70994]:   <devices>
Jul 27 12:47:12 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:47:12 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:47:12 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk"/>
Jul 27 12:47:12 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:47:12 user nova-compute[70994]:     </disk>
Jul 27 12:47:12 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:47:12 user nova-compute[70994]:       <mac address="fa:16:3e:44:3f:08"/>
Jul 27 12:47:12 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:12 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:47:12 user nova-compute[70994]:       <target dev="tap33013b4d-59"/>
Jul 27 12:47:12 user nova-compute[70994]:     </interface>
Jul 27 12:47:12 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:47:12 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/console.log" append="off"/>
Jul 27 12:47:12 user nova-compute[70994]:     </serial>
Jul 27 12:47:12 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:47:12 user nova-compute[70994]:     <video>
Jul 27 12:47:12 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:12 user nova-compute[70994]:     </video>
Jul 27 12:47:12 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:47:12 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:47:12 user nova-compute[70994]:     </rng>
Jul 27 12:47:12 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:47:12 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:47:12 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:47:12 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:12 user nova-compute[70994]:   </devices>
Jul 27 12:47:12 user nova-compute[70994]: </domain>
Jul 27 12:47:12 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1006968374',display_name='tempest-ServerStableDeviceRescueTest-server-1006968374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1006968374',id=22,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9cAQdEUwCjJ5NO/sU7pixKf7Ep1zH+79GJq+9pKHMOmoNI5F/OrHSlARsbOP9FjCl/CzuGGo0+IHt60ofxd4AqnC0785A6FFyW+GyYs7Je9M0sRHs9yyg058u3CDXiMQ==',key_name='tempest-keypair-1267023795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bf2ec7ac6ff456eb3ef1f52241a742e',ramdisk_id='',reservation_id='r-d3aagtse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-373928889',owner_user_name='tempest-ServerStableDeviceRescueTest-373928889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f8edd1555a642b8b776aa6d329a1eaa',uuid=f9432eac-732b-4dcc-b8af-abb390b7cb55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converting VIF {"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG os_vif [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33013b4d-59, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33013b4d-59, col_values=(('external_ids', {'iface-id': '33013b4d-599e-46b0-9f2d-446217b3e442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:3f:08', 'vm-uuid': 'f9432eac-732b-4dcc-b8af-abb390b7cb55'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:12 user nova-compute[70994]: INFO os_vif [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59')
Jul 27 12:47:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No VIF found with MAC fa:16:3e:44:3f:08, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:47:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updated VIF entry in instance network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:47:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0cd9c190-eb32-4bca-bbd8-e8c18831c11e req-42b6e664-4f24-4a1f-a863-5c4319400920 service nova] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:14 user nova-compute[70994]: WARNING nova.compute.manager [req-feb3f83b-2329-4fab-98e3-f93f8312c4b6 req-118877be-8048-45d0-82ed-b6edf2e6e010 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state building and task_state spawning.
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:47:15 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:47:15 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:47:15 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:15 user nova-compute[70994]: INFO nova.compute.manager [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Terminating instance
Jul 27 12:47:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5236984d-8ff8-49dc-82d3-90406fd0374f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:47:15 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f3b5c2-8f57-4c4a-8470-8d9e01249822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec757cf-7663-47b7-bd70-a0a046979fcb]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85503189-8f0e-4330-8bef-fc802ecaa041]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a7215a-09fd-49cc-a594-ef253c188a71]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pywhkVTD'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c868d91-5ab4-40b3-a7fe-0e4fbe5ca285]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4cc90-487d-4f3c-aea9-c49961aecc86]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fcfdd-fa4c-4355-86bb-14bfd4d7739a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:47:15 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2944a897-2e81-4c67-a99e-36600a9062e1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[832d6ddc-a0ec-4e68-bf0d-c8efd71699d4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:15 user nova-compute[70994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:15 user nova-compute[70994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:15 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38396c89-bc89-492b-827d-2768dcd5029a]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-unplugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] No waiting events found dispatching network-vif-unplugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-13236540-3fb2-4b29-a0fd-af3dcc694b85 req-3965f051-6a26-42e1-a01d-535b39a44491 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-unplugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:16 user nova-compute[70994]: WARNING nova.compute.manager [req-b6e686a9-e011-4521-b6a6-5a292b37f48f req-2b97329f-74a0-4e90-9040-600f257e0c37 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state building and task_state spawning.
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Instance destroyed successfully.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.objects.instance [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'resources' on Instance uuid b4befc11-c528-4b29-bdd4-e3d0e9b82700 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:45:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1772848237',display_name='tempest-VolumesActionsTest-instance-1772848237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1772848237',id=20,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-bsry0hls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:28Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=b4befc11-c528-4b29-bdd4-e3d0e9b82700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "address": "fa:16:3e:a5:9e:e1", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecea308-29", "ovs_interfaceid": "decea308-29ed-4464-8a7d-f78e87b8e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG os_vif [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecea308-29, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:16 user nova-compute[70994]: INFO os_vif [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9e:e1,bridge_name='br-int',has_traffic_filtering=True,id=decea308-29ed-4464-8a7d-f78e87b8e1a9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecea308-29')
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Deleting instance files /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700_del
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Deletion of /opt/stack/data/nova/instances/b4befc11-c528-4b29-bdd4-e3d0e9b82700_del complete
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462036.5258672, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Resumed (Lifecycle Event)
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance spawned successfully.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462036.5260818, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Started (Lifecycle Event)
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Took 6.19 seconds to spawn the instance on the hypervisor.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:16 user nova-compute[70994]: INFO nova.compute.manager [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Took 7.04 seconds to build instance.
Jul 27 12:47:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-63d3a458-fb26-4411-b25a-d4fa514c7c19 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.127s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'flavor' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:47:16 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:47:16 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:47:16 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:47:16 user nova-compute[70994]:   <serial>a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad</serial>
Jul 27 12:47:16 user nova-compute[70994]: </disk>
Jul 27 12:47:16 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:17 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Took 0.63 seconds to deallocate network for instance.
Jul 27 12:47:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No VIF found with MAC fa:16:3e:6f:65:65, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a497adf5-03a8-4da0-94a2-c4ca3ee56138 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.348s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:17 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Deleted allocations for instance b4befc11-c528-4b29-bdd4-e3d0e9b82700
Jul 27 12:47:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77a151e4-40f4-4595-b542-bf335edb98fe tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] Acquiring lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] Lock "b4befc11-c528-4b29-bdd4-e3d0e9b82700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] No waiting events found dispatching network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:18 user nova-compute[70994]: WARNING nova.compute.manager [req-a391a5ea-6437-4c57-9117-4324456e288f req-54363363-94ea-44ac-a590-a77fae461fba service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received unexpected event network-vif-plugged-decea308-29ed-4464-8a7d-f78e87b8e1a9 for instance with vm_state deleted and task_state None.
Jul 27 12:47:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-7bf3baf6-e0d1-47c7-a439-f04e809e8081 req-30f97cb1-d849-4515-9f41-92564c5f4739 service nova] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Received event network-vif-deleted-decea308-29ed-4464-8a7d-f78e87b8e1a9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Stashing vm_state: active {{(pid=70994) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'pci_requests' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:47:19 user nova-compute[70994]: INFO nova.compute.claims [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Claim successful on node user
Jul 27 12:47:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'resources' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'pci_devices' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:20 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating resource usage from migration 1693d5d1-6851-402e-89fd-0438ae742f73
Jul 27 12:47:20 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.513s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:20 user nova-compute[70994]: INFO nova.compute.manager [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Migrating
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:20 user nova-compute[70994]: INFO nova.compute.rpcapi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:47:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Starting migrate_disk_and_power_off {{(pid=70994) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:21 user nova-compute[70994]: WARNING nova.compute.manager [req-ec9e51c2-aa49-4fb1-961f-e2859d57ef23 req-78a846e1-063d-4176-9c3b-f4c0b400645f service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state active and task_state resize_migrating.
Jul 27 12:47:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance destroyed successfully.
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG os_vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3418446e-e2, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:21 user nova-compute[70994]: INFO os_vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:47:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:47:22 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38160287-15fd-4332-a829-6ae5289be817]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:47:22 user nova-compute[70994]: No targets found.
Jul 27 12:47:22 user nova-compute[70994]: iSNS:
Jul 27 12:47:22 user nova-compute[70994]: No targets found.
Jul 27 12:47:22 user nova-compute[70994]: STATIC:
Jul 27 12:47:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad
Jul 27 12:47:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:47:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:47:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:47:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:47:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:47:22 user nova-compute[70994]: FIRMWARE:
Jul 27 12:47:22 user nova-compute[70994]: No targets found.
Jul 27 12:47:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:47:22 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:47:22 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f2ed3-207e-4dd2-b375-9826acc49253]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0c9c3-9666-461f-9b78-cf56fd9ce139]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:22 user nova-compute[70994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:22 user nova-compute[70994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f410d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d78305-340c-4431-9a40-c140a3339ba2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9525464c-9b10-4aab-a55b-9729949f281e]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5499d8d-60d3-4341-b3f2-692544877dfb]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[887416fd-2f38-46aa-8f1d-782e010002f6]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c13501-0267-41a7-8f03-ed8594f1acd7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c73c41-0bf1-4cb4-a2b0-031c5b383c7c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:47:22 user nova-compute[70994]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:47:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae501d88-0c2b-4371-a854-f03a7f743510]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== disconnect_volume: return (338ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_resize/disk /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "cp -r /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_resize/disk /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk" returned: 0 in 0.297s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_resize/disk.info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk.info {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "cp -r /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_resize/disk.info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk.info" returned: 0 in 0.043s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:23 user nova-compute[70994]: WARNING nova.compute.manager [req-37d398aa-3f5a-4990-a547-398e6a8c94f0 req-efbf6e96-aa62-47fe-8e81-378d6a0ec13c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state active and task_state resize_migrating.
Jul 27 12:47:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Port 3418446e-e2a1-4516-a37e-be94d79fbf4f binding to destination host user is already ACTIVE {{(pid=70994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG nova.network.neutron [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.utils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93fbb80-fd7d-4931-80e2-02f2921a190c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a5978-7ff9-4705-82ed-7cbb138880f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ac4d0-4f5a-49fa-afd6-e057821657c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b89f51-26d5-47a6-bafd-82b86586398f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:47:24 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:47:24 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[355980f9-9822-49bf-9839-a38f850989b0]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:47:24 user nova-compute[70994]: DEBUG os_brick.utils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:47:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:47:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:47:27 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462036.4594772, b4befc11-c528-4b29-bdd4-e3d0e9b82700 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:31 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] VM Stopped (Lifecycle Event)
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-233333ae-9cfb-4b08-b764-8f5c5608c72f None None] [instance: b4befc11-c528-4b29-bdd4-e3d0e9b82700] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Starting finish_migration {{(pid=70994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:47:31 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Creating image(s)
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.objects.instance [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'trusted_certs' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk. size=21474836480 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk 21474836480 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk 21474836480" returned: 0 in 0.046s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Ensure instance console log exists: /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start _get_guest_xml network_info=[{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f57d289e-51df-412e-89ef-2698eef4453c', 'attached_at': '2023-07-27T12:47:31.000000', 'detached_at': '', 'volume_id': 'a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'serial': 'a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '857d1a96-f4b1-4735-9b39-711a2631fe98', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:47:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.objects.instance [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'vcpu_model' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:47:32 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:47:32 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:47:32 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b0aad-0c73-482d-b5a3-9b98aea0a35d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:47:32 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f12e41-d5dc-4317-be84-8fe2b5c75870]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2211f-d4ef-4127-b50d-e2239c87b086]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f5ba8-d78e-4689-a3bf-13bb205682ad]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e9911-cad9-428c-aa14-148777122995]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pywhkVTD'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee6b5d-fcbc-47e1-ab0c-da7e962a6875]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8427e-b8e4-4a90-b90f-019358692710]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5281029-9ae5-4285-bbb3-919e483d5044]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:47:32 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b85ff-8889-4eac-a9ac-c7313a7f9ea8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75770833-50db-47dc-9359-417a94915b29]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:32 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:47:32 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:47:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a61a9f0-ec89-433a-ae89-6b463a70fc30]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:47:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:47:33 user nova-compute[70994]:   <uuid>f57d289e-51df-412e-89ef-2698eef4453c</uuid>
Jul 27 12:47:33 user nova-compute[70994]:   <name>instance-00000012</name>
Jul 27 12:47:33 user nova-compute[70994]:   <memory>2097152</memory>
Jul 27 12:47:33 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:47:33 user nova-compute[70994]:   <metadata>
Jul 27 12:47:33 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:33 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherB-server-1698964685</nova:name>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:47:32</nova:creationTime>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:flavor name="m1.small">
Jul 27 12:47:33 user nova-compute[70994]:         <nova:memory>2048</nova:memory>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:disk>20</nova:disk>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:33 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:owner>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:user uuid="300a2b66d5aa4551ba7a35107feb15f0">tempest-ServerActionsTestOtherB-413140038-project-member</nova:user>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:project uuid="df70a3a511c2416994b9b5864f29a387">tempest-ServerActionsTestOtherB-413140038</nova:project>
Jul 27 12:47:33 user nova-compute[70994]:       </nova:owner>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:33 user nova-compute[70994]:       <nova:ports>
Jul 27 12:47:33 user nova-compute[70994]:         <nova:port uuid="3418446e-e2a1-4516-a37e-be94d79fbf4f">
Jul 27 12:47:33 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:47:33 user nova-compute[70994]:         </nova:port>
Jul 27 12:47:33 user nova-compute[70994]:       </nova:ports>
Jul 27 12:47:33 user nova-compute[70994]:     </nova:instance>
Jul 27 12:47:33 user nova-compute[70994]:   </metadata>
Jul 27 12:47:33 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:47:33 user nova-compute[70994]:     <system>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="serial">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="uuid">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:47:33 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:47:33 user nova-compute[70994]:     </system>
Jul 27 12:47:33 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:33 user nova-compute[70994]:   <os>
Jul 27 12:47:33 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:47:33 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:47:33 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:47:33 user nova-compute[70994]:   </os>
Jul 27 12:47:33 user nova-compute[70994]:   <features>
Jul 27 12:47:33 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:33 user nova-compute[70994]:     <apic/>
Jul 27 12:47:33 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:47:33 user nova-compute[70994]:   </features>
Jul 27 12:47:33 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:47:33 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:47:33 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:47:33 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:47:33 user nova-compute[70994]:   </clock>
Jul 27 12:47:33 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:47:33 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:47:33 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:47:33 user nova-compute[70994]:   </cpu>
Jul 27 12:47:33 user nova-compute[70994]:   <devices>
Jul 27 12:47:33 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:47:33 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:47:33 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk"/>
Jul 27 12:47:33 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:47:33 user nova-compute[70994]:     </disk>
Jul 27 12:47:33 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:47:33 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:47:33 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:47:33 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:47:33 user nova-compute[70994]:       <serial>a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad</serial>
Jul 27 12:47:33 user nova-compute[70994]:     </disk>
Jul 27 12:47:33 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:47:33 user nova-compute[70994]:       <mac address="fa:16:3e:6f:65:65"/>
Jul 27 12:47:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:33 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:47:33 user nova-compute[70994]:       <target dev="tap3418446e-e2"/>
Jul 27 12:47:33 user nova-compute[70994]:     </interface>
Jul 27 12:47:33 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:47:33 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/console.log" append="off"/>
Jul 27 12:47:33 user nova-compute[70994]:     </serial>
Jul 27 12:47:33 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:47:33 user nova-compute[70994]:     <video>
Jul 27 12:47:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:33 user nova-compute[70994]:     </video>
Jul 27 12:47:33 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:47:33 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:47:33 user nova-compute[70994]:     </rng>
Jul 27 12:47:33 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:47:33 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:47:33 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:47:33 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:33 user nova-compute[70994]:   </devices>
Jul 27 12:47:33 user nova-compute[70994]: </domain>
Jul 27 12:47:33 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-778208627-network", "vif_mac": "fa:16:3e:6f:65:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG os_vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3418446e-e2, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3418446e-e2, col_values=(('external_ids', {'iface-id': '3418446e-e2a1-4516-a37e-be94d79fbf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:65:65', 'vm-uuid': 'f57d289e-51df-412e-89ef-2698eef4453c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:33 user nova-compute[70994]: INFO os_vif [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] No VIF found with MAC fa:16:3e:6f:65:65, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:47:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:35 user nova-compute[70994]: WARNING nova.compute.manager [req-7671cdda-3ccf-44b6-a81d-f433904b0368 req-66160c80-33dd-4071-aa7f-55ecc1af5b08 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state active and task_state resize_finish.
Jul 27 12:47:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:36 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:36 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462041.969643, f57d289e-51df-412e-89ef-2698eef4453c => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:36 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Stopped (Lifecycle Event)
Jul 27 12:47:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e1f4bf1f-b444-48f9-b64e-206a71396c26 None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:37 user nova-compute[70994]: WARNING nova.compute.manager [req-4399e271-bc86-4a62-ba36-14fc2864fde8 req-83e932ec-3643-48f7-8554-7ba7d526ce50 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state active and task_state resize_finish.
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462057.3552544, f57d289e-51df-412e-89ef-2698eef4453c => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:37 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Resumed (Lifecycle Event)
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:47:37 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance running successfully.
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Failed to set time: agent not configured {{(pid=70994) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-492d4065-68fb-4dc6-a17a-07da7c056599 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] finish_migration finished successfully. {{(pid=70994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:37 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462057.3587704, f57d289e-51df-412e-89ef-2698eef4453c => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:37 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Started (Lifecycle Event)
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:37 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 12:47:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.472023010253906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Applying migration context for instance f57d289e-51df-412e-89ef-2698eef4453c as it has an incoming, in-progress migration 1693d5d1-6851-402e-89fd-0438ae742f73. Migration status is finished {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 12:47:42 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating resource usage from migration 1693d5d1-6851-402e-89fd-0438ae742f73
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b33c60f9-d979-419e-aa9a-9f0844c35e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 526e9d52-53e8-4c83-b147-08dbf52f6aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 201a7ef6-4cc0-4e56-8559-52d524bafe16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Migration 1693d5d1-6851-402e-89fd-0438ae742f73 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:47:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:47:45 user nova-compute[70994]: INFO nova.compute.claims [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Claim successful on node user
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:47:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:47:45 user nova-compute[70994]: DEBUG nova.policy [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d2b3b0a6c14b74a73370fda30251f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7fc676a5924df880ae87b91900fab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:47:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Creating image(s)
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk 1073741824" returned: 0 in 0.052s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Cannot resize image /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Successfully created port: 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Successfully updated port: 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing instance network info cache due to event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.neutron [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance network_info: |[{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.neutron [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start _get_guest_xml network_info=[{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:47:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355877842',display_name='tempest-ServerRescueNegativeTestJSON-server-1355877842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355877842',id=23,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmKyItTG+LMuGbv/kyalGYAo/fWmbk/9mxmeCeAsGBw7J2CIXXDmsJeZ9cywYg3vPF2UcWjCyv4n1mnRH8+gT2HkPD1TJuUiAIJoZ1/W3OFZmAkg6SDysMhi0sHafYtuQ==',key_name='tempest-keypair-1732909560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-3el1wn82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=b5a77277-e67a-4d4f-9203-36ec4040f373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:47:48 user nova-compute[70994]:   <uuid>b5a77277-e67a-4d4f-9203-36ec4040f373</uuid>
Jul 27 12:47:48 user nova-compute[70994]:   <name>instance-00000017</name>
Jul 27 12:47:48 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:47:48 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:47:48 user nova-compute[70994]:   <metadata>
Jul 27 12:47:48 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:47:48 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355877842</nova:name>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:47:48</nova:creationTime>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:47:48 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:47:48 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:owner>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:47:48 user nova-compute[70994]:       </nova:owner>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:47:48 user nova-compute[70994]:       <nova:ports>
Jul 27 12:47:48 user nova-compute[70994]:         <nova:port uuid="015b578b-c90a-40da-a6c8-ef45c11642fe">
Jul 27 12:47:48 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:47:48 user nova-compute[70994]:         </nova:port>
Jul 27 12:47:48 user nova-compute[70994]:       </nova:ports>
Jul 27 12:47:48 user nova-compute[70994]:     </nova:instance>
Jul 27 12:47:48 user nova-compute[70994]:   </metadata>
Jul 27 12:47:48 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:47:48 user nova-compute[70994]:     <system>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="serial">b5a77277-e67a-4d4f-9203-36ec4040f373</entry>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="uuid">b5a77277-e67a-4d4f-9203-36ec4040f373</entry>
Jul 27 12:47:48 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:47:48 user nova-compute[70994]:     </system>
Jul 27 12:47:48 user nova-compute[70994]:   </sysinfo>
Jul 27 12:47:48 user nova-compute[70994]:   <os>
Jul 27 12:47:48 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:47:48 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:47:48 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:47:48 user nova-compute[70994]:   </os>
Jul 27 12:47:48 user nova-compute[70994]:   <features>
Jul 27 12:47:48 user nova-compute[70994]:     <acpi/>
Jul 27 12:47:48 user nova-compute[70994]:     <apic/>
Jul 27 12:47:48 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:47:48 user nova-compute[70994]:   </features>
Jul 27 12:47:48 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:47:48 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:47:48 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:47:48 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:47:48 user nova-compute[70994]:   </clock>
Jul 27 12:47:48 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:47:48 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:47:48 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:47:48 user nova-compute[70994]:   </cpu>
Jul 27 12:47:48 user nova-compute[70994]:   <devices>
Jul 27 12:47:48 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:47:48 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:47:48 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk"/>
Jul 27 12:47:48 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:47:48 user nova-compute[70994]:     </disk>
Jul 27 12:47:48 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:47:48 user nova-compute[70994]:       <mac address="fa:16:3e:dd:6f:36"/>
Jul 27 12:47:48 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:48 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:47:48 user nova-compute[70994]:       <target dev="tap015b578b-c9"/>
Jul 27 12:47:48 user nova-compute[70994]:     </interface>
Jul 27 12:47:48 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:47:48 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/console.log" append="off"/>
Jul 27 12:47:48 user nova-compute[70994]:     </serial>
Jul 27 12:47:48 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:47:48 user nova-compute[70994]:     <video>
Jul 27 12:47:48 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:47:48 user nova-compute[70994]:     </video>
Jul 27 12:47:48 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:47:48 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:47:48 user nova-compute[70994]:     </rng>
Jul 27 12:47:48 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:47:48 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:47:48 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:47:48 user nova-compute[70994]:     </memballoon>
Jul 27 12:47:48 user nova-compute[70994]:   </devices>
Jul 27 12:47:48 user nova-compute[70994]: </domain>
Jul 27 12:47:48 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355877842',display_name='tempest-ServerRescueNegativeTestJSON-server-1355877842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355877842',id=23,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmKyItTG+LMuGbv/kyalGYAo/fWmbk/9mxmeCeAsGBw7J2CIXXDmsJeZ9cywYg3vPF2UcWjCyv4n1mnRH8+gT2HkPD1TJuUiAIJoZ1/W3OFZmAkg6SDysMhi0sHafYtuQ==',key_name='tempest-keypair-1732909560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-3el1wn82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=b5a77277-e67a-4d4f-9203-36ec4040f373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG os_vif [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap015b578b-c9, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap015b578b-c9, col_values=(('external_ids', {'iface-id': '015b578b-c90a-40da-a6c8-ef45c11642fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:6f:36', 'vm-uuid': 'b5a77277-e67a-4d4f-9203-36ec4040f373'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:48 user nova-compute[70994]: INFO os_vif [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9')
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:dd:6f:36, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.neutron [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updated VIF entry in instance network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG nova.network.neutron [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-703b5233-5013-4cb1-99a8-2bb630a1e3ac req-dd6c2e70-30e3-4024-967f-4ca638260cd7 service nova] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:49 user nova-compute[70994]: WARNING nova.compute.manager [req-de24a106-9b2c-48ba-b0de-8c20d981e3e5 req-5680e3bf-c5ae-4aa0-aa71-1bc75a17ca4b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state building and task_state spawning.
Jul 27 12:47:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:50 user nova-compute[70994]: INFO nova.compute.manager [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Terminating instance
Jul 27 12:47:50 user nova-compute[70994]: DEBUG nova.compute.manager [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Instance destroyed successfully.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.objects.instance [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lazy-loading 'resources' on Instance uuid 526e9d52-53e8-4c83-b147-08dbf52f6aff {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T12:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2034990454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2034990454',id=19,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB/ho0XWU167KX07EGDSSYHEAtm9ObAXySxtMGPLPZ73dvOhxBSEDvfpWj+tDIHB4oTebuqUHrqJivbUof7ZIMt0kWvD0V5bVJuS2LteMNAsmcK+ZnjbkCfLMN3yjofIw==',key_name='tempest-keypair-665650466',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51b59d9a59094d3392ea26f8c280b61e',ramdisk_id='',reservation_id='r-o9ghq6bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-445980369',owner_user_name='tempest-TaggedAttachmentsTest-445980369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6732bc36ed624e9ea1464f56036ad866',uuid=526e9d52-53e8-4c83-b147-08dbf52f6aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converting VIF {"id": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "address": "fa:16:3e:be:d6:51", "network": {"id": "1438b11d-de68-410b-b2a6-278b5681f769", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1294321497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51b59d9a59094d3392ea26f8c280b61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd073ea-18", "ovs_interfaceid": "4fd073ea-1892-4d4b-be31-f770ebbc4312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG os_vif [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fd073ea-18, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:47:51 user nova-compute[70994]: INFO os_vif [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d6:51,bridge_name='br-int',has_traffic_filtering=True,id=4fd073ea-1892-4d4b-be31-f770ebbc4312,network=Network(1438b11d-de68-410b-b2a6-278b5681f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd073ea-18')
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Deleting instance files /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff_del
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Deletion of /opt/stack/data/nova/instances/526e9d52-53e8-4c83-b147-08dbf52f6aff_del complete
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:51 user nova-compute[70994]: WARNING nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state building and task_state spawning.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-unplugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-unplugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-unplugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Acquiring lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] No waiting events found dispatching network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:47:51 user nova-compute[70994]: WARNING nova.compute.manager [req-96c6e860-e643-43dc-b27c-d23346cb6dab req-c4d84f53-fefe-4cba-9013-1a820198feb7 service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received unexpected event network-vif-plugged-4fd073ea-1892-4d4b-be31-f770ebbc4312 for instance with vm_state active and task_state deleting.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462071.8494325, b5a77277-e67a-4d4f-9203-36ec4040f373 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Resumed (Lifecycle Event)
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance spawned successfully.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462071.8509088, b5a77277-e67a-4d4f-9203-36ec4040f373 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Started (Lifecycle Event)
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:47:51 user nova-compute[70994]: INFO nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Took 5.99 seconds to spawn the instance on the hypervisor.
Jul 27 12:47:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:47:52 user nova-compute[70994]: INFO nova.compute.manager [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Took 6.86 seconds to build instance.
Jul 27 12:47:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d7da525b-c53d-4147-92a4-69f39170ab20 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.027s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:47:52 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Took 0.98 seconds to deallocate network for instance.
Jul 27 12:47:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:47:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:52 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Deleted allocations for instance 526e9d52-53e8-4c83-b147-08dbf52f6aff
Jul 27 12:47:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-30c2d173-e34a-497c-96c3-1bfbf97da0bc tempest-TaggedAttachmentsTest-445980369 tempest-TaggedAttachmentsTest-445980369-project-member] Lock "526e9d52-53e8-4c83-b147-08dbf52f6aff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.449s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:47:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc2d0e0f-f722-406f-ac84-99dc5ff54566 req-ff12a0dc-1782-40f0-8927-34097032501f service nova] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Received event network-vif-deleted-4fd073ea-1892-4d4b-be31-f770ebbc4312 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:47:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:47:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:00 user nova-compute[70994]: INFO nova.compute.manager [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Terminating instance
Jul 27 12:48:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-unplugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-unplugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4a34b0eb-04c3-4f4d-8f35-f9cf5edbb7a6 req-447a6ff0-4318-49d0-afd1-d13fec34a172 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-unplugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Instance destroyed successfully.
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.objects.instance [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lazy-loading 'resources' on Instance uuid b33c60f9-d979-419e-aa9a-9f0844c35e62 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-615866170',display_name='tempest-ServersNegativeTestJSON-server-615866170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-615866170',id=2,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11c5028166444a07a4f9ccdc9206df91',ramdisk_id='',reservation_id='r-jptcwggv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-334834209',owner_user_name='tempest-ServersNegativeTestJSON-334834209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:39:27Z,user_data=None,user_id='f524fef921904389beb9e62ddd33512e',uuid=b33c60f9-d979-419e-aa9a-9f0844c35e62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converting VIF {"id": "b39988d1-bde2-4498-846c-a335093246e0", "address": "fa:16:3e:bb:3a:48", "network": {"id": "3ef04b59-05c4-4612-acc6-9b082efee028", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1386662247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11c5028166444a07a4f9ccdc9206df91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39988d1-bd", "ovs_interfaceid": "b39988d1-bde2-4498-846c-a335093246e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG os_vif [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb39988d1-bd, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:01 user nova-compute[70994]: INFO os_vif [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3a:48,bridge_name='br-int',has_traffic_filtering=True,id=b39988d1-bde2-4498-846c-a335093246e0,network=Network(3ef04b59-05c4-4612-acc6-9b082efee028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39988d1-bd')
Jul 27 12:48:01 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Deleting instance files /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62_del
Jul 27 12:48:01 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Deletion of /opt/stack/data/nova/instances/b33c60f9-d979-419e-aa9a-9f0844c35e62_del complete
Jul 27 12:48:01 user nova-compute[70994]: INFO nova.compute.manager [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 12:48:01 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:48:01 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:02 user nova-compute[70994]: WARNING nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state active and task_state deleting.
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:02 user nova-compute[70994]: WARNING nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state active and task_state deleting.
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:02 user nova-compute[70994]: WARNING nova.compute.manager [req-2395e091-8df1-4ea4-8dd6-788f1ad0d129 req-8b69d81d-6fc2-4eee-b9a7-36a8bd1bc7d4 service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state active and task_state deleting.
Jul 27 12:48:03 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:03 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Took 1.50 seconds to deallocate network for instance.
Jul 27 12:48:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:03 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:03 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:03 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Deleted allocations for instance b33c60f9-d979-419e-aa9a-9f0844c35e62
Jul 27 12:48:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-27058c78-a73b-46c9-a91d-4272736059d5 tempest-ServersNegativeTestJSON-334834209 tempest-ServersNegativeTestJSON-334834209-project-member] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] Acquiring lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] Lock "b33c60f9-d979-419e-aa9a-9f0844c35e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] No waiting events found dispatching network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:05 user nova-compute[70994]: WARNING nova.compute.manager [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received unexpected event network-vif-plugged-b39988d1-bde2-4498-846c-a335093246e0 for instance with vm_state deleted and task_state None.
Jul 27 12:48:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-12331dcb-e521-43e7-ba0c-4796e45bee92 req-8b630dab-3815-4782-a4a6-66adc33149fb service nova] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Received event network-vif-deleted-b39988d1-bde2-4498-846c-a335093246e0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:06 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462071.3233452, 526e9d52-53e8-4c83-b147-08dbf52f6aff => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:06 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] VM Stopped (Lifecycle Event)
Jul 27 12:48:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dad51357-0664-43a2-9242-f8ccb088137d None None] [instance: 526e9d52-53e8-4c83-b147-08dbf52f6aff] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:48:07 user nova-compute[70994]: INFO nova.compute.claims [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Claim successful on node user
Jul 27 12:48:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:48:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:48:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG nova.policy [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9007dda5491b4be58773e5d5fdf4278c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a37134c2e84d14aa2d476053deeab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:48:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Creating image(s)
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "/opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "/opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.251s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk 1073741824" returned: 0 in 0.054s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:48:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Successfully created port: 18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Cannot resize image /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.objects.instance [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'migration_context' on Instance uuid d1e872dc-1497-406f-97f6-539f550b20b9 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Successfully updated port: 18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquired lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-changed-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Refreshing instance network info cache due to event network-changed-18f70eb4-30b2-4af2-8538-c12122c507e9. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:48:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] Acquiring lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Updating instance_info_cache with network_info: [{"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Releasing lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Instance network_info: |[{"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] Acquired lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Refreshing network info cache for port 18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Start _get_guest_xml network_info=[{"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:48:10 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:10 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-920956001',display_name='tempest-VolumesActionsTest-instance-920956001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-920956001',id=24,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-dusia08j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:08Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=d1e872dc-1497-406f-97f6-539f550b20b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.objects.instance [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'pci_devices' on Instance uuid d1e872dc-1497-406f-97f6-539f550b20b9 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:48:10 user nova-compute[70994]:   <uuid>d1e872dc-1497-406f-97f6-539f550b20b9</uuid>
Jul 27 12:48:10 user nova-compute[70994]:   <name>instance-00000018</name>
Jul 27 12:48:10 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:48:10 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:48:10 user nova-compute[70994]:   <metadata>
Jul 27 12:48:10 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:48:10 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:name>tempest-VolumesActionsTest-instance-920956001</nova:name>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:48:10</nova:creationTime>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:48:10 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:48:10 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:owner>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:user uuid="9007dda5491b4be58773e5d5fdf4278c">tempest-VolumesActionsTest-757189479-project-member</nova:user>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:project uuid="01a37134c2e84d14aa2d476053deeab5">tempest-VolumesActionsTest-757189479</nova:project>
Jul 27 12:48:10 user nova-compute[70994]:       </nova:owner>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:48:10 user nova-compute[70994]:       <nova:ports>
Jul 27 12:48:10 user nova-compute[70994]:         <nova:port uuid="18f70eb4-30b2-4af2-8538-c12122c507e9">
Jul 27 12:48:10 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 12:48:10 user nova-compute[70994]:         </nova:port>
Jul 27 12:48:10 user nova-compute[70994]:       </nova:ports>
Jul 27 12:48:10 user nova-compute[70994]:     </nova:instance>
Jul 27 12:48:10 user nova-compute[70994]:   </metadata>
Jul 27 12:48:10 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:48:10 user nova-compute[70994]:     <system>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="serial">d1e872dc-1497-406f-97f6-539f550b20b9</entry>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="uuid">d1e872dc-1497-406f-97f6-539f550b20b9</entry>
Jul 27 12:48:10 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:48:10 user nova-compute[70994]:     </system>
Jul 27 12:48:10 user nova-compute[70994]:   </sysinfo>
Jul 27 12:48:10 user nova-compute[70994]:   <os>
Jul 27 12:48:10 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:48:10 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:48:10 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:48:10 user nova-compute[70994]:   </os>
Jul 27 12:48:10 user nova-compute[70994]:   <features>
Jul 27 12:48:10 user nova-compute[70994]:     <acpi/>
Jul 27 12:48:10 user nova-compute[70994]:     <apic/>
Jul 27 12:48:10 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:48:10 user nova-compute[70994]:   </features>
Jul 27 12:48:10 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:48:10 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:48:10 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:48:10 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:48:10 user nova-compute[70994]:   </clock>
Jul 27 12:48:10 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:48:10 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:48:10 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:48:10 user nova-compute[70994]:   </cpu>
Jul 27 12:48:10 user nova-compute[70994]:   <devices>
Jul 27 12:48:10 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:48:10 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:48:10 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk"/>
Jul 27 12:48:10 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:48:10 user nova-compute[70994]:     </disk>
Jul 27 12:48:10 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:48:10 user nova-compute[70994]:       <mac address="fa:16:3e:3f:94:0c"/>
Jul 27 12:48:10 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:10 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:48:10 user nova-compute[70994]:       <target dev="tap18f70eb4-30"/>
Jul 27 12:48:10 user nova-compute[70994]:     </interface>
Jul 27 12:48:10 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:48:10 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/console.log" append="off"/>
Jul 27 12:48:10 user nova-compute[70994]:     </serial>
Jul 27 12:48:10 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:48:10 user nova-compute[70994]:     <video>
Jul 27 12:48:10 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:10 user nova-compute[70994]:     </video>
Jul 27 12:48:10 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:48:10 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:48:10 user nova-compute[70994]:     </rng>
Jul 27 12:48:10 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:48:10 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:48:10 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:48:10 user nova-compute[70994]:     </memballoon>
Jul 27 12:48:10 user nova-compute[70994]:   </devices>
Jul 27 12:48:10 user nova-compute[70994]: </domain>
Jul 27 12:48:10 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-920956001',display_name='tempest-VolumesActionsTest-instance-920956001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-920956001',id=24,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-dusia08j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:08Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=d1e872dc-1497-406f-97f6-539f550b20b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG os_vif [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18f70eb4-30, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18f70eb4-30, col_values=(('external_ids', {'iface-id': '18f70eb4-30b2-4af2-8538-c12122c507e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:94:0c', 'vm-uuid': 'd1e872dc-1497-406f-97f6-539f550b20b9'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:10 user nova-compute[70994]: INFO os_vif [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30')
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] No VIF found with MAC fa:16:3e:3f:94:0c, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Updated VIF entry in instance network info cache for port 18f70eb4-30b2-4af2-8538-c12122c507e9. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Updating instance_info_cache with network_info: [{"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3be54d02-e671-40f6-84e8-bc5e111d9756 req-f9ff0957-5fe5-4ce5-b10f-e78bbc5e0ca5 service nova] Releasing lock "refresh_cache-d1e872dc-1497-406f-97f6-539f550b20b9" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] No waiting events found dispatching network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:12 user nova-compute[70994]: WARNING nova.compute.manager [req-12a0985f-dd4b-4000-ab81-c48b03ce516d req-a778dd92-3e91-4616-beb3-67ab0b7c23ca service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received unexpected event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 for instance with vm_state building and task_state spawning.
Jul 27 12:48:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462094.191375, d1e872dc-1497-406f-97f6-539f550b20b9 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] VM Resumed (Lifecycle Event)
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Instance spawned successfully.
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] No waiting events found dispatching network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:14 user nova-compute[70994]: WARNING nova.compute.manager [req-5d2253e7-51bd-4bdd-ad9d-f59af0912f52 req-2c8ab253-19e1-4099-aee1-772d378b8b87 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received unexpected event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 for instance with vm_state building and task_state spawning.
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462094.1967406, d1e872dc-1497-406f-97f6-539f550b20b9 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] VM Started (Lifecycle Event)
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Took 6.34 seconds to spawn the instance on the hypervisor.
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:14 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.claims [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Claim successful on node user
Jul 27 12:48:14 user nova-compute[70994]: INFO nova.compute.manager [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Took 7.30 seconds to build instance.
Jul 27 12:48:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-162e5718-c90c-479f-8a84-17ea69eb321c tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.399s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:48:15 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:48:15 user nova-compute[70994]: INFO nova.virt.block_device [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Booting with volume 82253e41-1032-4b7f-8b32-91176983d625 at /dev/vda
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.policy [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e02d7aebd3e46beb2f554956eb3804c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba79eb748dd4e26b0be6a26705bda45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.utils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158d644-d128-4732-bfe9-5e2483a25c8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eccbcc8-3883-488d-be54-17caea46d9d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[27960994-0fe9-44df-bb47-c70fc69683c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01e6491-a53d-4069-a005-52861bd6fe24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:48:15 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:48:15 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d319ba39-b4f8-496e-a781-ab248a8838f0]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG os_brick.utils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating existing volume attachment record: 9cc78be2-4271-4ce0-b597-7c6a649b8e29 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:48:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:16 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Successfully created port: a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:48:16 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462081.3947768, b33c60f9-d979-419e-aa9a-9f0844c35e62 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:16 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] VM Stopped (Lifecycle Event)
Jul 27 12:48:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-84887db6-a348-424d-b1a0-432d9911ded8 None None] [instance: b33c60f9-d979-419e-aa9a-9f0844c35e62] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Successfully updated port: a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-changed-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Refreshing instance network info cache due to event network-changed-a65b020f-1b45-4235-95ec-22d237d2d66d. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance network_info: |[{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Refreshing network info cache for port a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:48:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:18 user nova-compute[70994]: DEBUG nova.network.neutron [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updated VIF entry in instance network info cache for port a65b020f-1b45-4235-95ec-22d237d2d66d. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:48:18 user nova-compute[70994]: DEBUG nova.network.neutron [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5f3c7d43-d222-4967-ba2c-5cce40a75a7b req-07ef2fb8-e11d-404a-a996-d62bc9b39f4a service nova] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:48:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Creating image(s)
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Ensure instance console log exists: /opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start _get_guest_xml network_info=[{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '537420c1-3f63-4dd9-ad48-cd5c1d8247dc', 'attached_at': '', 'detached_at': '', 'volume_id': '82253e41-1032-4b7f-8b32-91176983d625', 'serial': '82253e41-1032-4b7f-8b32-91176983d625'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '9cc78be2-4271-4ce0-b597-7c6a649b8e29', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:48:22 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:22 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:48:22 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:48:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:48:22 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:48:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:48:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:48:22 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:48:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dfc831-a819-4bdd-9967-3b50616c35f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:48:23 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f678ca-fc86-4978-a167-bd1fa62b3d64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625] added
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[818eefa4-6e4c-4627-b163-658969c85ad0]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e533f-4be1-42e8-be8a-248fd4238e22]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsXRTqiL {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsXRTqiL" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b197301a-c45c-40d3-b6b8-df0f11c59870]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsXRTqiL'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35183d9e-4970-490d-a080-ca8d5dfa85b8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c94083-fe6e-4b02-abc8-8f329d80bb2e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a7e8a-1f6b-43d1-a7dd-d514ae99c86d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]
Jul 27 12:48:23 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[721fb683-1c6a-4641-9d52-f7fadea295fd]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c4ab5-dab9-49eb-bef1-8f32fcd9bccf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:48:23 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:48:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87aeee-b89b-43de-89ef-20ff1c403e09]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:48:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23931653732316339', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653732316339', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.objects.instance [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_devices' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:48:24 user nova-compute[70994]:   <uuid>537420c1-3f63-4dd9-ad48-cd5c1d8247dc</uuid>
Jul 27 12:48:24 user nova-compute[70994]:   <name>instance-00000019</name>
Jul 27 12:48:24 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:48:24 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:48:24 user nova-compute[70994]:   <metadata>
Jul 27 12:48:24 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:48:24 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:48:24 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherA-server-533728173</nova:name>
Jul 27 12:48:24 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:48:22</nova:creationTime>
Jul 27 12:48:24 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:48:24 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:48:24 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:48:24 user nova-compute[70994]:       <nova:owner>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:user uuid="2e02d7aebd3e46beb2f554956eb3804c">tempest-ServerActionsTestOtherA-1320950418-project-member</nova:user>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:project uuid="dba79eb748dd4e26b0be6a26705bda45">tempest-ServerActionsTestOtherA-1320950418</nova:project>
Jul 27 12:48:24 user nova-compute[70994]:       </nova:owner>
Jul 27 12:48:24 user nova-compute[70994]:       <nova:ports>
Jul 27 12:48:24 user nova-compute[70994]:         <nova:port uuid="a65b020f-1b45-4235-95ec-22d237d2d66d">
Jul 27 12:48:24 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:48:24 user nova-compute[70994]:         </nova:port>
Jul 27 12:48:24 user nova-compute[70994]:       </nova:ports>
Jul 27 12:48:24 user nova-compute[70994]:     </nova:instance>
Jul 27 12:48:24 user nova-compute[70994]:   </metadata>
Jul 27 12:48:24 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:48:24 user nova-compute[70994]:     <system>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="serial">537420c1-3f63-4dd9-ad48-cd5c1d8247dc</entry>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="uuid">537420c1-3f63-4dd9-ad48-cd5c1d8247dc</entry>
Jul 27 12:48:24 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:48:24 user nova-compute[70994]:     </system>
Jul 27 12:48:24 user nova-compute[70994]:   </sysinfo>
Jul 27 12:48:24 user nova-compute[70994]:   <os>
Jul 27 12:48:24 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:48:24 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:48:24 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:48:24 user nova-compute[70994]:   </os>
Jul 27 12:48:24 user nova-compute[70994]:   <features>
Jul 27 12:48:24 user nova-compute[70994]:     <acpi/>
Jul 27 12:48:24 user nova-compute[70994]:     <apic/>
Jul 27 12:48:24 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:48:24 user nova-compute[70994]:   </features>
Jul 27 12:48:24 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:48:24 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:48:24 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:48:24 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:48:24 user nova-compute[70994]:   </clock>
Jul 27 12:48:24 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:48:24 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:48:24 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:48:24 user nova-compute[70994]:   </cpu>
Jul 27 12:48:24 user nova-compute[70994]:   <devices>
Jul 27 12:48:24 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:48:24 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:48:24 user nova-compute[70994]:       <source dev="/dev/sdd"/>
Jul 27 12:48:24 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:48:24 user nova-compute[70994]:       <serial>82253e41-1032-4b7f-8b32-91176983d625</serial>
Jul 27 12:48:24 user nova-compute[70994]:     </disk>
Jul 27 12:48:24 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:48:24 user nova-compute[70994]:       <mac address="fa:16:3e:6b:36:bb"/>
Jul 27 12:48:24 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:24 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:48:24 user nova-compute[70994]:       <target dev="tapa65b020f-1b"/>
Jul 27 12:48:24 user nova-compute[70994]:     </interface>
Jul 27 12:48:24 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:48:24 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc/console.log" append="off"/>
Jul 27 12:48:24 user nova-compute[70994]:     </serial>
Jul 27 12:48:24 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:48:24 user nova-compute[70994]:     <video>
Jul 27 12:48:24 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:24 user nova-compute[70994]:     </video>
Jul 27 12:48:24 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:48:24 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:48:24 user nova-compute[70994]:     </rng>
Jul 27 12:48:24 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:48:24 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:48:24 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:48:24 user nova-compute[70994]:     </memballoon>
Jul 27 12:48:24 user nova-compute[70994]:   </devices>
Jul 27 12:48:24 user nova-compute[70994]: </domain>
Jul 27 12:48:24 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG os_vif [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65b020f-1b, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa65b020f-1b, col_values=(('external_ids', {'iface-id': 'a65b020f-1b45-4235-95ec-22d237d2d66d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:36:bb', 'vm-uuid': '537420c1-3f63-4dd9-ad48-cd5c1d8247dc'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:24 user nova-compute[70994]: INFO os_vif [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b')
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:48:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No VIF found with MAC fa:16:3e:6b:36:bb, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:48:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:26 user nova-compute[70994]: WARNING nova.compute.manager [req-a74f1a22-cd91-4fb8-a0ef-d01b9af2bbc3 req-a07468fa-6bec-439a-98c7-f87626f42cc0 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state building and task_state spawning.
Jul 27 12:48:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462108.0036998, 537420c1-3f63-4dd9-ad48-cd5c1d8247dc => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] VM Resumed (Lifecycle Event)
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:28 user nova-compute[70994]: WARNING nova.compute.manager [req-4b596171-cba9-4037-8c5d-2be88175b6e4 req-675a588a-acc7-4be5-ab5a-1a7ce61ef99b service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state building and task_state spawning.
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance spawned successfully.
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462108.0642774, 537420c1-3f63-4dd9-ad48-cd5c1d8247dc => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] VM Started (Lifecycle Event)
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Took 5.36 seconds to spawn the instance on the hypervisor.
Jul 27 12:48:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:28 user nova-compute[70994]: INFO nova.compute.manager [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Took 13.98 seconds to build instance.
Jul 27 12:48:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-1fde4e62-c684-4fb5-8b32-45c478c7b82b tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.123s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lazy-loading 'info_cache' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:48:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing instance network info cache due to event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:35 user nova-compute[70994]: DEBUG nova.network.neutron [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:48:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updated VIF entry in instance network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:48:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a73054c-cb4e-4686-8f23-10932018afec req-83feb0e6-e0a2-4c5d-9163-9f161d826f23 service nova] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:48:41 user nova-compute[70994]: INFO nova.compute.claims [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Claim successful on node user
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:41 user nova-compute[70994]: INFO nova.compute.manager [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Shelving
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:41 user nova-compute[70994]: WARNING nova.compute.manager [req-b8f6c432-bf4b-45f9-8a83-681977b6f9ab req-63f82b77-9dcf-4825-a3ca-b7686498fe5d service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state active and task_state shelving.
Jul 27 12:48:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7249MB free_disk=25.465824127197266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance destroyed successfully.
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Beginning cold snapshot process
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.440s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.117s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:48:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Applying migration context for instance f57d289e-51df-412e-89ef-2698eef4453c as it has an incoming, in-progress migration 1693d5d1-6851-402e-89fd-0438ae742f73. Migration status is finished {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 12:48:42 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating resource usage from migration 1693d5d1-6851-402e-89fd-0438ae742f73
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 201a7ef6-4cc0-4e56-8559-52d524bafe16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Migration 1693d5d1-6851-402e-89fd-0438ae742f73 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance d1e872dc-1497-406f-97f6-539f550b20b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk /opt/stack/data/nova/instances/snapshots/tmp9221cgda/4fc464f44ba54e5886097ff9285f20d7 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.policy [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '593a7d28021a47b491c7fa86af3edc80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cd4ff8af2445179cc6ba07c251dd4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:48:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Creating image(s)
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "/opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.174s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.191s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk 1073741824" returned: 0 in 0.128s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk /opt/stack/data/nova/instances/snapshots/tmp9221cgda/4fc464f44ba54e5886097ff9285f20d7" returned: 0 in 0.812s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Snapshot extracted, beginning image upload
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:43 user nova-compute[70994]: WARNING nova.compute.manager [req-c9942af2-39df-4d44-9770-70bc02525562 req-dbb3f4dc-97cd-4a05-9693-d2186b2eea6a service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.114s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Cannot resize image /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.objects.instance [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'migration_context' on Instance uuid 1233d1bf-9c86-45fb-8ed6-bd15064226d3 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Ensure instance console log exists: /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Successfully created port: 8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Successfully updated port: 8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-changed-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Refreshing instance network info cache due to event network-changed-8b853aae-ac89-4593-8b6c-8787ae70341d. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] Acquiring lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:44 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.neutron [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updating instance_info_cache with network_info: [{"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Instance network_info: |[{"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] Acquired lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Refreshing network info cache for port 8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Start _get_guest_xml network_info=[{"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:48:45 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:45 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723803136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723803136',id=26,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-88xk52bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:43Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=1233d1bf-9c86-45fb-8ed6-bd15064226d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid 1233d1bf-9c86-45fb-8ed6-bd15064226d3 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:48:45 user nova-compute[70994]:   <uuid>1233d1bf-9c86-45fb-8ed6-bd15064226d3</uuid>
Jul 27 12:48:45 user nova-compute[70994]:   <name>instance-0000001a</name>
Jul 27 12:48:45 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:48:45 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:48:45 user nova-compute[70994]:   <metadata>
Jul 27 12:48:45 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:48:45 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-723803136</nova:name>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:48:45</nova:creationTime>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:48:45 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:48:45 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:owner>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:48:45 user nova-compute[70994]:       </nova:owner>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:48:45 user nova-compute[70994]:       <nova:ports>
Jul 27 12:48:45 user nova-compute[70994]:         <nova:port uuid="8b853aae-ac89-4593-8b6c-8787ae70341d">
Jul 27 12:48:45 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 12:48:45 user nova-compute[70994]:         </nova:port>
Jul 27 12:48:45 user nova-compute[70994]:       </nova:ports>
Jul 27 12:48:45 user nova-compute[70994]:     </nova:instance>
Jul 27 12:48:45 user nova-compute[70994]:   </metadata>
Jul 27 12:48:45 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:48:45 user nova-compute[70994]:     <system>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="serial">1233d1bf-9c86-45fb-8ed6-bd15064226d3</entry>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="uuid">1233d1bf-9c86-45fb-8ed6-bd15064226d3</entry>
Jul 27 12:48:45 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:48:45 user nova-compute[70994]:     </system>
Jul 27 12:48:45 user nova-compute[70994]:   </sysinfo>
Jul 27 12:48:45 user nova-compute[70994]:   <os>
Jul 27 12:48:45 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:48:45 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:48:45 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:48:45 user nova-compute[70994]:   </os>
Jul 27 12:48:45 user nova-compute[70994]:   <features>
Jul 27 12:48:45 user nova-compute[70994]:     <acpi/>
Jul 27 12:48:45 user nova-compute[70994]:     <apic/>
Jul 27 12:48:45 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:48:45 user nova-compute[70994]:   </features>
Jul 27 12:48:45 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:48:45 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:48:45 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:48:45 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:48:45 user nova-compute[70994]:   </clock>
Jul 27 12:48:45 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:48:45 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:48:45 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:48:45 user nova-compute[70994]:   </cpu>
Jul 27 12:48:45 user nova-compute[70994]:   <devices>
Jul 27 12:48:45 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:48:45 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:48:45 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk"/>
Jul 27 12:48:45 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:48:45 user nova-compute[70994]:     </disk>
Jul 27 12:48:45 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:48:45 user nova-compute[70994]:       <mac address="fa:16:3e:38:0e:fd"/>
Jul 27 12:48:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:45 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:48:45 user nova-compute[70994]:       <target dev="tap8b853aae-ac"/>
Jul 27 12:48:45 user nova-compute[70994]:     </interface>
Jul 27 12:48:45 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:48:45 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/console.log" append="off"/>
Jul 27 12:48:45 user nova-compute[70994]:     </serial>
Jul 27 12:48:45 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:48:45 user nova-compute[70994]:     <video>
Jul 27 12:48:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:48:45 user nova-compute[70994]:     </video>
Jul 27 12:48:45 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:48:45 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:48:45 user nova-compute[70994]:     </rng>
Jul 27 12:48:45 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:48:45 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:48:45 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:48:45 user nova-compute[70994]:     </memballoon>
Jul 27 12:48:45 user nova-compute[70994]:   </devices>
Jul 27 12:48:45 user nova-compute[70994]: </domain>
Jul 27 12:48:45 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723803136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723803136',id=26,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-88xk52bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:48:43Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=1233d1bf-9c86-45fb-8ed6-bd15064226d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG os_vif [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b853aae-ac, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b853aae-ac, col_values=(('external_ids', {'iface-id': '8b853aae-ac89-4593-8b6c-8787ae70341d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:0e:fd', 'vm-uuid': '1233d1bf-9c86-45fb-8ed6-bd15064226d3'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:45 user nova-compute[70994]: INFO os_vif [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac')
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:38:0e:fd, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updated VIF entry in instance network info cache for port 8b853aae-ac89-4593-8b6c-8787ae70341d. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.network.neutron [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updating instance_info_cache with network_info: [{"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47d4fb34-1dba-495a-8e9c-094a27af8544 req-d82c2f38-557b-4431-9b60-09a0dfba26c3 service nova] Releasing lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Snapshot image upload complete
Jul 27 12:48:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:45 user nova-compute[70994]: INFO nova.compute.manager [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Shelve offloading
Jul 27 12:48:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance destroyed successfully.
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] There are 0 instances to clean {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance destroyed successfully.
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.objects.instance [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'resources' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8fiHOQb+lEJ5NUA0fNEH0ky8zAYxfDHFHtM8YUbsyNxEzIOdAk+tEYGZJU7rhlBemvGXf562vSJkaqPZ7ThpO/Brhtg2ISN6Zs/H9G1Ta9yOa/SDi2saFOggL4b5jKaQ==',key_name='tempest-keypair-268239023',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:48:45.922964',shelved_host='user',shelved_image_id='d045984e-c1ab-419c-b280-a663cc46e76c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG os_vif [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing instance network info cache due to event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6633dff-0d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: INFO os_vif [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d')
Jul 27 12:48:47 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Deleting instance files /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16_del
Jul 27 12:48:47 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Deletion of /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16_del complete
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] No waiting events found dispatching network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:47 user nova-compute[70994]: WARNING nova.compute.manager [req-76f90fd1-cfe5-4fe1-8600-66e81e913f34 req-e7789412-480c-480b-92b9-fa97b5da14fc service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received unexpected event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d for instance with vm_state building and task_state spawning.
Jul 27 12:48:47 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Deleted allocations for instance 201a7ef6-4cc0-4e56-8559-52d524bafe16
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.objects.instance [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'numa_topology' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updated VIF entry in instance network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd6633dff-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:48:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e730838-5d14-43dd-a9d9-f76da1c0e885 req-ee4705be-b90c-46f6-b82d-d255cdd98d87 service nova] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:48:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7cc94362-e49c-422b-a60f-9eb2c03b5867 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:48:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:48:48 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462128.9901648, 1233d1bf-9c86-45fb-8ed6-bd15064226d3 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:48 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] VM Resumed (Lifecycle Event)
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Instance spawned successfully.
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462128.990284, 1233d1bf-9c86-45fb-8ed6-bd15064226d3 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] VM Started (Lifecycle Event)
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Took 6.41 seconds to spawn the instance on the hypervisor.
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:49 user nova-compute[70994]: INFO nova.compute.manager [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Took 8.34 seconds to build instance.
Jul 27 12:48:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-86a78a4b-39af-4af4-ab1d-24f66f572977 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.595s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:48:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] No waiting events found dispatching network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:48:49 user nova-compute[70994]: WARNING nova.compute.manager [req-dd7ca0de-4eb4-414a-b268-755c7638ec51 req-1b4e9986-a1d0-48c5-9549-9997965acb6d service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received unexpected event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d for instance with vm_state active and task_state None.
Jul 27 12:48:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:57 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462121.854733, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:48:57 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Stopped (Lifecycle Event)
Jul 27 12:48:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-66d502df-38a1-4f1a-ab21-d92a781a3ab7 None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:48:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:48:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing instance network info cache due to event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:49:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:01 user nova-compute[70994]: DEBUG nova.network.neutron [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updated VIF entry in instance network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-52e0a12d-8be2-4c02-b323-63c5c62b4f5f req-734721ee-4350-467c-b42d-139c0147f792 service nova] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:02 user nova-compute[70994]: INFO nova.compute.manager [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] instance snapshotting
Jul 27 12:49:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Beginning live snapshot process
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119.delta 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119.delta 1073741824" returned: 0 in 0.051s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 12:49:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:49:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:49:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 12:49:05 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:49:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119.delta /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119.delta /opt/stack/data/nova/instances/snapshots/tmp_0mfh_h1/53d6640c18174ab68ed863fcb806d119" returned: 0 in 0.348s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Snapshot extracted, beginning image upload
Jul 27 12:49:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Snapshot image upload complete
Jul 27 12:49:08 user nova-compute[70994]: INFO nova.compute.manager [None req-969df89f-fe35-4f52-9d25-ebcd841b1c5b tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Took 5.18 seconds to snapshot the instance on the hypervisor.
Jul 27 12:49:09 user nova-compute[70994]: DEBUG nova.network.neutron [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Port 3418446e-e2a1-4516-a37e-be94d79fbf4f binding to destination host user is already ACTIVE {{(pid=70994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 12:49:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:09 user nova-compute[70994]: DEBUG nova.network.neutron [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:49:10 user nova-compute[70994]: INFO nova.compute.claims [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Claim successful on node user
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Creating tmpfile /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/tmpur9as5g6 to verify with other compute node that the instance is on the same shared storage. {{(pid=70994) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:10 user nova-compute[70994]: WARNING nova.compute.manager [req-3e04b66f-c805-4921-869c-9b47e430604b req-e351a478-97ed-4932-b691-2e2c7bbeab2a service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state resized and task_state resize_reverting.
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:49:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:49:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance destroyed successfully.
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'resources' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:47:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3418446e-e2, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:49:11 user nova-compute[70994]: INFO os_vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.policy [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f01edb66ab454f91812588fe77761874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620a0246ab1483d95c9f00fe7911b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:49:11 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c14e2-45f6-44d2-86ac-09e7957e9a70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:49:11 user nova-compute[70994]: No targets found.
Jul 27 12:49:11 user nova-compute[70994]: iSNS:
Jul 27 12:49:11 user nova-compute[70994]: No targets found.
Jul 27 12:49:11 user nova-compute[70994]: STATIC:
Jul 27 12:49:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:49:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:49:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:49:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad
Jul 27 12:49:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:49:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:49:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:49:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:49:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:49:11 user nova-compute[70994]: FIRMWARE:
Jul 27 12:49:11 user nova-compute[70994]: No targets found.
Jul 27 12:49:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:49:11 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:49:11 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:49:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Creating image(s)
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "/opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d56309-fc7b-4619-ac5f-aa5d07660c75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[832d800a-9541-4aa5-8be1-3e26b0d736b8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:11 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:11 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:11 user nova-compute[70994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:11 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc74a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20cae8-414e-4ba6-b34e-e22cd7cd4347]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa93b56-db79-4a49-a784-07f8d4194dac]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2a144-d503-4534-901d-9883bc2635a5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b6489-8600-4675-a1bf-3d1ae71e6ab6]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09dc848-d257-42ad-acb6-9a3930cfa4ef]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a22618-e5ed-4820-9130-a8aecc993ae2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:49:11 user nova-compute[70994]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:49:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk 1073741824" returned: 0 in 0.055s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad258ac-ae19-4498-b005-da61b92b720c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== disconnect_volume: return (453ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Cannot resize image /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'migration_context' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Successfully created port: e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Ensure instance console log exists: /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'migration_context' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:12 user nova-compute[70994]: WARNING nova.compute.manager [req-ddefc568-6ade-441b-8005-13186c9fdbbf req-c805d34f-93be-4f98-bd94-d527e9ee3287 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state resized and task_state resize_reverting.
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Successfully updated port: e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquired lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-changed-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Refreshing instance network info cache due to event network-changed-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] Acquiring lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:12 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.neutron [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updating instance_info_cache with network_info: [{"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.535s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Releasing lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Instance network_info: |[{"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] Acquired lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Refreshing network info cache for port e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Start _get_guest_xml network_info=[{"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:49:13 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:13 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1144710596',display_name='tempest-AttachVolumeNegativeTest-server-1144710596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1144710596',id=27,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3S+SLXIyaushSkuE5VhvjPn2cR+ny1AxvCloNkmCv/HUJHHwsDfJ2VGghydVB8xhiRBW2mFpyK5fzAPxIvep5S5c1MhnSK86xXYBKYJQFTPsC45+Mu17SK8v4N3T6b9w==',key_name='tempest-keypair-886999848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-9ynto34a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=e24b9029-64dc-4b6b-ad8d-94f021bee52e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'pci_devices' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:49:13 user nova-compute[70994]:   <uuid>e24b9029-64dc-4b6b-ad8d-94f021bee52e</uuid>
Jul 27 12:49:13 user nova-compute[70994]:   <name>instance-0000001b</name>
Jul 27 12:49:13 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:49:13 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:49:13 user nova-compute[70994]:   <metadata>
Jul 27 12:49:13 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:49:13 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1144710596</nova:name>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:49:13</nova:creationTime>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:49:13 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:49:13 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:owner>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:user uuid="f01edb66ab454f91812588fe77761874">tempest-AttachVolumeNegativeTest-1889965975-project-member</nova:user>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:project uuid="b620a0246ab1483d95c9f00fe7911b14">tempest-AttachVolumeNegativeTest-1889965975</nova:project>
Jul 27 12:49:13 user nova-compute[70994]:       </nova:owner>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:49:13 user nova-compute[70994]:       <nova:ports>
Jul 27 12:49:13 user nova-compute[70994]:         <nova:port uuid="e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0">
Jul 27 12:49:13 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 12:49:13 user nova-compute[70994]:         </nova:port>
Jul 27 12:49:13 user nova-compute[70994]:       </nova:ports>
Jul 27 12:49:13 user nova-compute[70994]:     </nova:instance>
Jul 27 12:49:13 user nova-compute[70994]:   </metadata>
Jul 27 12:49:13 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:49:13 user nova-compute[70994]:     <system>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="serial">e24b9029-64dc-4b6b-ad8d-94f021bee52e</entry>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="uuid">e24b9029-64dc-4b6b-ad8d-94f021bee52e</entry>
Jul 27 12:49:13 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:49:13 user nova-compute[70994]:     </system>
Jul 27 12:49:13 user nova-compute[70994]:   </sysinfo>
Jul 27 12:49:13 user nova-compute[70994]:   <os>
Jul 27 12:49:13 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:49:13 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:49:13 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:49:13 user nova-compute[70994]:   </os>
Jul 27 12:49:13 user nova-compute[70994]:   <features>
Jul 27 12:49:13 user nova-compute[70994]:     <acpi/>
Jul 27 12:49:13 user nova-compute[70994]:     <apic/>
Jul 27 12:49:13 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:49:13 user nova-compute[70994]:   </features>
Jul 27 12:49:13 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:49:13 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:49:13 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:49:13 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:49:13 user nova-compute[70994]:   </clock>
Jul 27 12:49:13 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:49:13 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:49:13 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:49:13 user nova-compute[70994]:   </cpu>
Jul 27 12:49:13 user nova-compute[70994]:   <devices>
Jul 27 12:49:13 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:49:13 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:49:13 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk"/>
Jul 27 12:49:13 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:49:13 user nova-compute[70994]:     </disk>
Jul 27 12:49:13 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:49:13 user nova-compute[70994]:       <mac address="fa:16:3e:a0:be:5b"/>
Jul 27 12:49:13 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:13 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:49:13 user nova-compute[70994]:       <target dev="tape01b53b1-b7"/>
Jul 27 12:49:13 user nova-compute[70994]:     </interface>
Jul 27 12:49:13 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:49:13 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/console.log" append="off"/>
Jul 27 12:49:13 user nova-compute[70994]:     </serial>
Jul 27 12:49:13 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:49:13 user nova-compute[70994]:     <video>
Jul 27 12:49:13 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:13 user nova-compute[70994]:     </video>
Jul 27 12:49:13 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:49:13 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:49:13 user nova-compute[70994]:     </rng>
Jul 27 12:49:13 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:49:13 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:49:13 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:49:13 user nova-compute[70994]:     </memballoon>
Jul 27 12:49:13 user nova-compute[70994]:   </devices>
Jul 27 12:49:13 user nova-compute[70994]: </domain>
Jul 27 12:49:13 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1144710596',display_name='tempest-AttachVolumeNegativeTest-server-1144710596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1144710596',id=27,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3S+SLXIyaushSkuE5VhvjPn2cR+ny1AxvCloNkmCv/HUJHHwsDfJ2VGghydVB8xhiRBW2mFpyK5fzAPxIvep5S5c1MhnSK86xXYBKYJQFTPsC45+Mu17SK8v4N3T6b9w==',key_name='tempest-keypair-886999848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-9ynto34a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=e24b9029-64dc-4b6b-ad8d-94f021bee52e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG os_vif [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape01b53b1-b7, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape01b53b1-b7, col_values=(('external_ids', {'iface-id': 'e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:be:5b', 'vm-uuid': 'e24b9029-64dc-4b6b-ad8d-94f021bee52e'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:13 user nova-compute[70994]: INFO os_vif [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7')
Jul 27 12:49:13 user nova-compute[70994]: INFO nova.compute.manager [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Swapping old allocation on dict_keys(['171e9a47-00d8-4e90-9ceb-1b30c2928bd7']) held by migration 1693d5d1-6851-402e-89fd-0438ae742f73 for instance
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Overwriting current allocation {'allocations': {'171e9a47-00d8-4e90-9ceb-1b30c2928bd7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': 'df70a3a511c2416994b9b5864f29a387', 'user_id': '300a2b66d5aa4551ba7a35107feb15f0', 'consumer_generation': 1} on consumer f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:a0:be:5b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquired lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.neutron [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updated VIF entry in instance network info cache for port e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updating instance_info_cache with network_info: [{"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d11c86d1-fa31-407f-b328-3efd427a853d req-7575c38b-473d-4c2a-b6c5-5b4e358aaeec service nova] Releasing lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:49:14 user nova-compute[70994]: INFO nova.compute.claims [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Claim successful on node user
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.network.neutron [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Releasing lock "refresh_cache-f57d289e-51df-412e-89ef-2698eef4453c" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.utils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[05913e61-ac30-4208-a2b2-cd907233d23f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aca62c1-af21-4d33-bc1f-cf2f74b6489d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[657279fb-e0c3-41bc-b7aa-8fb6568a4813]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6267916d-e6f2-457c-805b-fe032c515cd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:49:14 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4088163-40ec-4d1a-9f90-43575c427dbc]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG os_brick.utils [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:49:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] No waiting events found dispatching network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:14 user nova-compute[70994]: WARNING nova.compute.manager [req-431addf9-b7e3-454d-b0f0-89bfbe5761a9 req-4311f407-5613-409d-a027-1760c6828104 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received unexpected event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 for instance with vm_state building and task_state spawning.
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:49:15 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Creating image(s)
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "/opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "/opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "/opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.policy [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26ce305dc6f8496ab27762d4ee337620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba243f600d674a72a4d1ecbb0c6429f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk 1073741824" returned: 0 in 0.070s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Cannot resize image /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.objects.instance [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lazy-loading 'migration_context' on Instance uuid 00f32d91-990e-46c2-bcbd-819391468efc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Ensure instance console log exists: /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Successfully created port: 7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462156.8962207, e24b9029-64dc-4b6b-ad8d-94f021bee52e => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] VM Resumed (Lifecycle Event)
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Instance spawned successfully.
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462156.898598, e24b9029-64dc-4b6b-ad8d-94f021bee52e => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] VM Started (Lifecycle Event)
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] No waiting events found dispatching network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:17 user nova-compute[70994]: WARNING nova.compute.manager [req-7d21c534-d7de-4147-bb03-6ad074e2763a req-8817a665-1892-4883-898e-1961984b4578 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received unexpected event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 for instance with vm_state building and task_state spawning.
Jul 27 12:49:17 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Successfully updated port: 7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquired lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:49:17 user nova-compute[70994]: INFO nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-changed-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Refreshing instance network info cache due to event network-changed-7c314e76-dbb5-4a6d-b100-1e63f1415df1. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] Acquiring lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:49:17 user nova-compute[70994]: INFO nova.compute.manager [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Took 6.89 seconds to build instance.
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-70c9592b-01db-4d42-aa62-12497427a621 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Updating instance_info_cache with network_info: [{"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Releasing lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Instance network_info: |[{"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] Acquired lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Refreshing network info cache for port 7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Start _get_guest_xml network_info=[{"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:49:17 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:17 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418164629',display_name='tempest-VolumesNegativeTest-instance-418164629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418164629',id=28,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba243f600d674a72a4d1ecbb0c6429f7',ramdisk_id='',reservation_id='r-oer04v83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2123507904',owner_user_name='tempest-VolumesNegativeTest-2123507904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:49:15Z,user_data=None,user_id='26ce305dc6f8496ab27762d4ee337620',uuid=00f32d91-990e-46c2-bcbd-819391468efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converting VIF {"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lazy-loading 'pci_devices' on Instance uuid 00f32d91-990e-46c2-bcbd-819391468efc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:49:17 user nova-compute[70994]:   <uuid>00f32d91-990e-46c2-bcbd-819391468efc</uuid>
Jul 27 12:49:17 user nova-compute[70994]:   <name>instance-0000001c</name>
Jul 27 12:49:17 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:49:17 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:49:17 user nova-compute[70994]:   <metadata>
Jul 27 12:49:17 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:49:17 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:name>tempest-VolumesNegativeTest-instance-418164629</nova:name>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:49:17</nova:creationTime>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:49:17 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:49:17 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:owner>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:user uuid="26ce305dc6f8496ab27762d4ee337620">tempest-VolumesNegativeTest-2123507904-project-member</nova:user>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:project uuid="ba243f600d674a72a4d1ecbb0c6429f7">tempest-VolumesNegativeTest-2123507904</nova:project>
Jul 27 12:49:17 user nova-compute[70994]:       </nova:owner>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:49:17 user nova-compute[70994]:       <nova:ports>
Jul 27 12:49:17 user nova-compute[70994]:         <nova:port uuid="7c314e76-dbb5-4a6d-b100-1e63f1415df1">
Jul 27 12:49:17 user nova-compute[70994]:           <nova:ip type="fixed" address="192.168.233.254" ipVersion="4"/>
Jul 27 12:49:17 user nova-compute[70994]:         </nova:port>
Jul 27 12:49:17 user nova-compute[70994]:       </nova:ports>
Jul 27 12:49:17 user nova-compute[70994]:     </nova:instance>
Jul 27 12:49:17 user nova-compute[70994]:   </metadata>
Jul 27 12:49:17 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:49:17 user nova-compute[70994]:     <system>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="serial">00f32d91-990e-46c2-bcbd-819391468efc</entry>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="uuid">00f32d91-990e-46c2-bcbd-819391468efc</entry>
Jul 27 12:49:17 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:49:17 user nova-compute[70994]:     </system>
Jul 27 12:49:17 user nova-compute[70994]:   </sysinfo>
Jul 27 12:49:17 user nova-compute[70994]:   <os>
Jul 27 12:49:17 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:49:17 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:49:17 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:49:17 user nova-compute[70994]:   </os>
Jul 27 12:49:17 user nova-compute[70994]:   <features>
Jul 27 12:49:17 user nova-compute[70994]:     <acpi/>
Jul 27 12:49:17 user nova-compute[70994]:     <apic/>
Jul 27 12:49:17 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:49:17 user nova-compute[70994]:   </features>
Jul 27 12:49:17 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:49:17 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:49:17 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:49:17 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:49:17 user nova-compute[70994]:   </clock>
Jul 27 12:49:17 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:49:17 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:49:17 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:49:17 user nova-compute[70994]:   </cpu>
Jul 27 12:49:17 user nova-compute[70994]:   <devices>
Jul 27 12:49:17 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:49:17 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:49:17 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk"/>
Jul 27 12:49:17 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:49:17 user nova-compute[70994]:     </disk>
Jul 27 12:49:17 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:49:17 user nova-compute[70994]:       <mac address="fa:16:3e:ff:74:32"/>
Jul 27 12:49:17 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:17 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:49:17 user nova-compute[70994]:       <target dev="tap7c314e76-db"/>
Jul 27 12:49:17 user nova-compute[70994]:     </interface>
Jul 27 12:49:17 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:49:17 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/console.log" append="off"/>
Jul 27 12:49:17 user nova-compute[70994]:     </serial>
Jul 27 12:49:17 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:49:17 user nova-compute[70994]:     <video>
Jul 27 12:49:17 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:17 user nova-compute[70994]:     </video>
Jul 27 12:49:17 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:49:17 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:49:17 user nova-compute[70994]:     </rng>
Jul 27 12:49:17 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:49:17 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:49:17 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:49:17 user nova-compute[70994]:     </memballoon>
Jul 27 12:49:17 user nova-compute[70994]:   </devices>
Jul 27 12:49:17 user nova-compute[70994]: </domain>
Jul 27 12:49:17 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418164629',display_name='tempest-VolumesNegativeTest-instance-418164629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418164629',id=28,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba243f600d674a72a4d1ecbb0c6429f7',ramdisk_id='',reservation_id='r-oer04v83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2123507904',owner_user_name='tempest-VolumesNegativeTest-2123507904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:49:15Z,user_data=None,user_id='26ce305dc6f8496ab27762d4ee337620',uuid=00f32d91-990e-46c2-bcbd-819391468efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converting VIF {"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG os_vif [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c314e76-db, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c314e76-db, col_values=(('external_ids', {'iface-id': '7c314e76-dbb5-4a6d-b100-1e63f1415df1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:74:32', 'vm-uuid': '00f32d91-990e-46c2-bcbd-819391468efc'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:17 user nova-compute[70994]: INFO os_vif [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db')
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] No VIF found with MAC fa:16:3e:ff:74:32, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Updated VIF entry in instance network info cache for port 7c314e76-dbb5-4a6d-b100-1e63f1415df1. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG nova.network.neutron [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Updating instance_info_cache with network_info: [{"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ff5b3c2c-dbca-4b75-9c10-ca62bc288a15 req-84281cc1-3936-4ae2-8cb6-641ad0e9b4bf service nova] Releasing lock "refresh_cache-00f32d91-990e-46c2-bcbd-819391468efc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] No waiting events found dispatching network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:19 user nova-compute[70994]: WARNING nova.compute.manager [req-e32a56fb-fa76-4f74-8288-d92ffffe8098 req-88438814-cdbb-4f8b-afe4-92b9e2a0f395 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received unexpected event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 for instance with vm_state building and task_state spawning.
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462161.3826993, 00f32d91-990e-46c2-bcbd-819391468efc => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] VM Resumed (Lifecycle Event)
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Instance spawned successfully.
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462161.3838394, 00f32d91-990e-46c2-bcbd-819391468efc => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] VM Started (Lifecycle Event)
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Took 6.46 seconds to spawn the instance on the hypervisor.
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] No waiting events found dispatching network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:21 user nova-compute[70994]: WARNING nova.compute.manager [req-ccec048b-a994-4a3d-907a-c69349152a76 req-fcb71f22-572c-4c4c-ad02-449782f1b81a service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received unexpected event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 for instance with vm_state building and task_state spawning.
Jul 27 12:49:21 user nova-compute[70994]: INFO nova.compute.manager [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Took 7.38 seconds to build instance.
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-77785ba8-2985-4811-8960-4667476fbf7c tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.490s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Starting finish_revert_migration {{(pid=70994) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start _get_guest_xml network_info=[{"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f57d289e-51df-412e-89ef-2698eef4453c', 'attached_at': '2023-07-27T12:49:22.000000', 'detached_at': '', 'volume_id': 'a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'serial': 'a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '14571cc1-205a-44dd-adb1-0693d921b4be', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:49:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'vcpu_model' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:49:21 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:49:21 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:49:21 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f71ec33-1ef3-41dc-b0a3-2301095e40a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:49:21 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762653b-a7dc-4730-a51e-99f91187e8ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad] added
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d4bee-4b60-4435-87e4-3f9209714226]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ccc6c-8784-48fe-9f47-2c99f0a7a3cf]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pywhkVTD" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d21515-fd04-4c38-ba67-4d03eb1fae7c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pywhkVTD'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98da89b-a20a-4349-bcc9-52a37b00cfc3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540a26a-a54e-42da-a93f-9a374c5bf146]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90244487-8079-4406-854a-da04df9a3648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:49:22 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce0ea3-cb05-4383-84e7-49ad3a548782]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bbcc3d-3b3f-4c27-8376-a1550b1da0ca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:22 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa95671-d8b6-454b-955a-6bbdc10bbe05]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261306137656661', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:47:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:49:23 user nova-compute[70994]:   <uuid>f57d289e-51df-412e-89ef-2698eef4453c</uuid>
Jul 27 12:49:23 user nova-compute[70994]:   <name>instance-00000012</name>
Jul 27 12:49:23 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:49:23 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:49:23 user nova-compute[70994]:   <metadata>
Jul 27 12:49:23 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:49:23 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherB-server-1698964685</nova:name>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:49:21</nova:creationTime>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:49:23 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:49:23 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:owner>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:user uuid="300a2b66d5aa4551ba7a35107feb15f0">tempest-ServerActionsTestOtherB-413140038-project-member</nova:user>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:project uuid="df70a3a511c2416994b9b5864f29a387">tempest-ServerActionsTestOtherB-413140038</nova:project>
Jul 27 12:49:23 user nova-compute[70994]:       </nova:owner>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:49:23 user nova-compute[70994]:       <nova:ports>
Jul 27 12:49:23 user nova-compute[70994]:         <nova:port uuid="3418446e-e2a1-4516-a37e-be94d79fbf4f">
Jul 27 12:49:23 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:49:23 user nova-compute[70994]:         </nova:port>
Jul 27 12:49:23 user nova-compute[70994]:       </nova:ports>
Jul 27 12:49:23 user nova-compute[70994]:     </nova:instance>
Jul 27 12:49:23 user nova-compute[70994]:   </metadata>
Jul 27 12:49:23 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:49:23 user nova-compute[70994]:     <system>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="serial">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="uuid">f57d289e-51df-412e-89ef-2698eef4453c</entry>
Jul 27 12:49:23 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:49:23 user nova-compute[70994]:     </system>
Jul 27 12:49:23 user nova-compute[70994]:   </sysinfo>
Jul 27 12:49:23 user nova-compute[70994]:   <os>
Jul 27 12:49:23 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:49:23 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:49:23 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:49:23 user nova-compute[70994]:   </os>
Jul 27 12:49:23 user nova-compute[70994]:   <features>
Jul 27 12:49:23 user nova-compute[70994]:     <acpi/>
Jul 27 12:49:23 user nova-compute[70994]:     <apic/>
Jul 27 12:49:23 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:49:23 user nova-compute[70994]:   </features>
Jul 27 12:49:23 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:49:23 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:49:23 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:49:23 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:49:23 user nova-compute[70994]:   </clock>
Jul 27 12:49:23 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:49:23 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:49:23 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:49:23 user nova-compute[70994]:   </cpu>
Jul 27 12:49:23 user nova-compute[70994]:   <devices>
Jul 27 12:49:23 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:49:23 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:49:23 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk"/>
Jul 27 12:49:23 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:49:23 user nova-compute[70994]:     </disk>
Jul 27 12:49:23 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:49:23 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:49:23 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:49:23 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:49:23 user nova-compute[70994]:       <serial>a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad</serial>
Jul 27 12:49:23 user nova-compute[70994]:     </disk>
Jul 27 12:49:23 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:49:23 user nova-compute[70994]:       <mac address="fa:16:3e:6f:65:65"/>
Jul 27 12:49:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:23 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:49:23 user nova-compute[70994]:       <target dev="tap3418446e-e2"/>
Jul 27 12:49:23 user nova-compute[70994]:     </interface>
Jul 27 12:49:23 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:49:23 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/console.log" append="off"/>
Jul 27 12:49:23 user nova-compute[70994]:     </serial>
Jul 27 12:49:23 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:49:23 user nova-compute[70994]:     <video>
Jul 27 12:49:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:23 user nova-compute[70994]:     </video>
Jul 27 12:49:23 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:49:23 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:49:23 user nova-compute[70994]:     </rng>
Jul 27 12:49:23 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:49:23 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:49:23 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:49:23 user nova-compute[70994]:     </memballoon>
Jul 27 12:49:23 user nova-compute[70994]:   </devices>
Jul 27 12:49:23 user nova-compute[70994]: </domain>
Jul 27 12:49:23 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:47:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG os_vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3418446e-e2, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3418446e-e2, col_values=(('external_ids', {'iface-id': '3418446e-e2a1-4516-a37e-be94d79fbf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:65:65', 'vm-uuid': 'f57d289e-51df-412e-89ef-2698eef4453c'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:49:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:23 user nova-compute[70994]: INFO os_vif [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:49:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:25 user nova-compute[70994]: WARNING nova.compute.manager [req-80417af4-104b-45e6-a661-989a4acb4eca req-12949eae-6533-4002-8e36-aa9ec76d5fd5 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state resized and task_state resize_reverting.
Jul 27 12:49:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:26 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462151.139687, f57d289e-51df-412e-89ef-2698eef4453c => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:26 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Stopped (Lifecycle Event)
Jul 27 12:49:26 user nova-compute[70994]: DEBUG nova.compute.manager [None req-8f45f849-8088-4e01-8611-a8fbe4425cfc None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462167.180524, f57d289e-51df-412e-89ef-2698eef4453c => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Resumed (Lifecycle Event)
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance running successfully.
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] finish_revert_migration finished successfully. {{(pid=70994) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462167.1902738, f57d289e-51df-412e-89ef-2698eef4453c => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Started (Lifecycle Event)
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:27 user nova-compute[70994]: WARNING nova.compute.manager [req-6502c04b-7196-4e25-8839-94aa96c502d6 req-f207036d-e5fa-4627-9434-5de2ba5f6c2d service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state resized and task_state resize_reverting.
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 12:49:27 user nova-compute[70994]: INFO nova.compute.manager [None req-695fa802-f82a-42f7-a826-46cacd468d56 tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance to original state: 'active'
Jul 27 12:49:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [{"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-e31094ff-43ca-4256-a933-25ee73995818" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:49:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing instance network info cache due to event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'flavor' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:36 user nova-compute[70994]: INFO nova.compute.manager [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Attaching volume 1dac2c13-d244-462e-a680-a1bb61647c30 to /dev/vdb
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updated VIF entry in instance network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f18c2f97-4271-4d22-b6e2-4188f5e1f586 req-04183331-e021-450d-b753-e59c18e51234 service nova] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG os_brick.utils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5565876-3831-49a5-a40c-1638af44b0c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d0e02-37de-4398-bf3d-0adef89db614]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:36 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eee3be-83c7-47d3-a478-905e1dd51f57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d54238-4af2-49bf-9e49-d2efa3ac3f41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:49:37 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c70d1d-5844-4f13-a5c3-df6c5aefb748]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG os_brick.utils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating existing volume attachment record: 87d9f7aa-affd-4d91-b685-a49cc6a5fb5f {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=6982MB free_disk=25.32015609741211GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance d1e872dc-1497-406f-97f6-539f550b20b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 00f32d91-990e-46c2-bcbd-819391468efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing inventories for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating ProviderTree inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing aggregate associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, aggregates: None {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 12:49:42 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing trait associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 12:49:43 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:49:43 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:49:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:49:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryptUPkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:49:44 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:49:44 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:49:44 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b529b-3488-42fb-85e8-5bf6c5b2d6be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:49:44 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf656f8-185b-494f-912a-f7459fbd4d20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30] added
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592edbb-69c6-4346-bf21-e14b25d65014]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804a699-9954-4aae-9842-8762851022f2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryptUPkY {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryptUPkY" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd40a00-37ad-4543-8b9b-cf13b18de053]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryptUPkY'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9d496-9b0f-4984-8bf9-e8c16c026228]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00c6c3-64ea-4ed8-9d2d-78c001607feb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cede743-160e-4eae-ab0d-2e24908c4bd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260]
Jul 27 12:49:44 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260] successful.
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c473f3e-ea24-4603-8da0-b5709c50969c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[345c2100-d7f1-4fa3-9a56-a799d4109442]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:49:44 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:49:44 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6afce-46b3-42d7-9af8-d0b228f87518]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:49:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryptUPkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23730373536356364', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373536356364', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'flavor' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:49:45 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:49:45 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:49:45 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:49:45 user nova-compute[70994]:   <serial>1dac2c13-d244-462e-a680-a1bb61647c30</serial>
Jul 27 12:49:45 user nova-compute[70994]: </disk>
Jul 27 12:49:45 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:dd:6f:36, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:49:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-431c2016-7df5-46a7-b867-ab91c20e7018 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.112s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:46 user nova-compute[70994]: INFO nova.compute.manager [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Rescuing
Jul 27 12:49:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:49:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:49:46 user nova-compute[70994]: DEBUG nova.network.neutron [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG nova.network.neutron [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:47 user nova-compute[70994]: WARNING nova.compute.manager [req-0b43edb8-731e-46fa-bb54-02aec41f9a52 req-44127e16-cbce-43ff-9dc1-f2342b918735 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state active and task_state rescuing.
Jul 27 12:49:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance destroyed successfully.
Jul 27 12:49:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Attempting rescue
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:49:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Creating image(s)
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue" returned: 0 in 0.052s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'migration_context' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start _get_guest_xml network_info=[{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:dd:6f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'numa_topology' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:48 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355877842',display_name='tempest-ServerRescueNegativeTestJSON-server-1355877842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355877842',id=23,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmKyItTG+LMuGbv/kyalGYAo/fWmbk/9mxmeCeAsGBw7J2CIXXDmsJeZ9cywYg3vPF2UcWjCyv4n1mnRH8+gT2HkPD1TJuUiAIJoZ1/W3OFZmAkg6SDysMhi0sHafYtuQ==',key_name='tempest-keypair-1732909560',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:47:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-3el1wn82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=b5a77277-e67a-4d4f-9203-36ec4040f373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:dd:6f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "vif_mac": "fa:16:3e:dd:6f:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.objects.instance [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:49:48 user nova-compute[70994]:   <uuid>b5a77277-e67a-4d4f-9203-36ec4040f373</uuid>
Jul 27 12:49:48 user nova-compute[70994]:   <name>instance-00000017</name>
Jul 27 12:49:48 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:49:48 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:49:48 user nova-compute[70994]:   <metadata>
Jul 27 12:49:48 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:49:48 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355877842</nova:name>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:49:48</nova:creationTime>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:49:48 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:49:48 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:owner>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:user uuid="10d2b3b0a6c14b74a73370fda30251f7">tempest-ServerRescueNegativeTestJSON-1795052237-project-member</nova:user>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:project uuid="dd7fc676a5924df880ae87b91900fab4">tempest-ServerRescueNegativeTestJSON-1795052237</nova:project>
Jul 27 12:49:48 user nova-compute[70994]:       </nova:owner>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:49:48 user nova-compute[70994]:       <nova:ports>
Jul 27 12:49:48 user nova-compute[70994]:         <nova:port uuid="015b578b-c90a-40da-a6c8-ef45c11642fe">
Jul 27 12:49:48 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:49:48 user nova-compute[70994]:         </nova:port>
Jul 27 12:49:48 user nova-compute[70994]:       </nova:ports>
Jul 27 12:49:48 user nova-compute[70994]:     </nova:instance>
Jul 27 12:49:48 user nova-compute[70994]:   </metadata>
Jul 27 12:49:48 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:49:48 user nova-compute[70994]:     <system>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="serial">b5a77277-e67a-4d4f-9203-36ec4040f373</entry>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="uuid">b5a77277-e67a-4d4f-9203-36ec4040f373</entry>
Jul 27 12:49:48 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:49:48 user nova-compute[70994]:     </system>
Jul 27 12:49:48 user nova-compute[70994]:   </sysinfo>
Jul 27 12:49:48 user nova-compute[70994]:   <os>
Jul 27 12:49:48 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:49:48 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:49:48 user nova-compute[70994]:   </os>
Jul 27 12:49:48 user nova-compute[70994]:   <features>
Jul 27 12:49:48 user nova-compute[70994]:     <acpi/>
Jul 27 12:49:48 user nova-compute[70994]:     <apic/>
Jul 27 12:49:48 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:49:48 user nova-compute[70994]:   </features>
Jul 27 12:49:48 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:49:48 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:49:48 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:49:48 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:49:48 user nova-compute[70994]:   </clock>
Jul 27 12:49:48 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:49:48 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:49:48 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:49:48 user nova-compute[70994]:   </cpu>
Jul 27 12:49:48 user nova-compute[70994]:   <devices>
Jul 27 12:49:48 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:49:48 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:49:48 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue"/>
Jul 27 12:49:48 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:49:48 user nova-compute[70994]:     </disk>
Jul 27 12:49:48 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:49:48 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:49:48 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk"/>
Jul 27 12:49:48 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:49:48 user nova-compute[70994]:     </disk>
Jul 27 12:49:48 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:49:48 user nova-compute[70994]:       <mac address="fa:16:3e:dd:6f:36"/>
Jul 27 12:49:48 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:48 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:49:48 user nova-compute[70994]:       <target dev="tap015b578b-c9"/>
Jul 27 12:49:48 user nova-compute[70994]:     </interface>
Jul 27 12:49:48 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:49:48 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/console.log" append="off"/>
Jul 27 12:49:48 user nova-compute[70994]:     </serial>
Jul 27 12:49:48 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:49:48 user nova-compute[70994]:     <video>
Jul 27 12:49:48 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:49:48 user nova-compute[70994]:     </video>
Jul 27 12:49:48 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:49:48 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:49:48 user nova-compute[70994]:     </rng>
Jul 27 12:49:48 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:49:48 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:49:48 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:49:48 user nova-compute[70994]:     </memballoon>
Jul 27 12:49:48 user nova-compute[70994]:   </devices>
Jul 27 12:49:48 user nova-compute[70994]: </domain>
Jul 27 12:49:48 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:49:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance destroyed successfully.
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:49:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] No VIF found with MAC fa:16:3e:dd:6f:36, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:49:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:49 user nova-compute[70994]: DEBUG nova.compute.manager [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:49 user nova-compute[70994]: WARNING nova.compute.manager [req-40c83202-eb81-4b41-92b1-d2559b2d1b07 req-046aaf6b-1619-404d-bd46-30f4c0df4291 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state active and task_state rescuing.
Jul 27 12:49:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:51 user nova-compute[70994]: WARNING nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state active and task_state rescuing.
Jul 27 12:49:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:51 user nova-compute[70994]: DEBUG nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:51 user nova-compute[70994]: WARNING nova.compute.manager [req-f7156e42-c1ec-4ef5-a0fc-1f5dd4530f93 req-6218377f-a2c2-4bac-ac5f-2efe7d67a99c service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state active and task_state rescuing.
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for b5a77277-e67a-4d4f-9203-36ec4040f373 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462192.5163896, b5a77277-e67a-4d4f-9203-36ec4040f373 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:52 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Resumed (Lifecycle Event)
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-560aca02-2115-436a-9911-47327c79ce19 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:52 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462192.517601, b5a77277-e67a-4d4f-9203-36ec4040f373 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:49:52 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Started (Lifecycle Event)
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:49:52 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:49:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:57 user nova-compute[70994]: INFO nova.compute.manager [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Terminating instance
Jul 27 12:49:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:49:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-unplugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] No waiting events found dispatching network-vif-unplugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-219691fd-ce7e-4b1d-9b0d-3419e7d1990d req-20c6d6a9-c1b7-4258-ba23-13bcc9580753 service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-unplugged-18f70eb4-30b2-4af2-8538-c12122c507e9 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:49:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Instance destroyed successfully.
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lazy-loading 'resources' on Instance uuid d1e872dc-1497-406f-97f6-539f550b20b9 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-920956001',display_name='tempest-VolumesActionsTest-instance-920956001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-920956001',id=24,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01a37134c2e84d14aa2d476053deeab5',ramdisk_id='',reservation_id='r-dusia08j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-757189479',owner_user_name='tempest-VolumesActionsTest-757189479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:48:14Z,user_data=None,user_id='9007dda5491b4be58773e5d5fdf4278c',uuid=d1e872dc-1497-406f-97f6-539f550b20b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converting VIF {"id": "18f70eb4-30b2-4af2-8538-c12122c507e9", "address": "fa:16:3e:3f:94:0c", "network": {"id": "5fa04f91-fab8-4c82-8c73-ee42e7a5595e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1116866367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01a37134c2e84d14aa2d476053deeab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f70eb4-30", "ovs_interfaceid": "18f70eb4-30b2-4af2-8538-c12122c507e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG os_vif [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18f70eb4-30, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:49:58 user nova-compute[70994]: INFO os_vif [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:94:0c,bridge_name='br-int',has_traffic_filtering=True,id=18f70eb4-30b2-4af2-8538-c12122c507e9,network=Network(5fa04f91-fab8-4c82-8c73-ee42e7a5595e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f70eb4-30')
Jul 27 12:49:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Deleting instance files /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9_del
Jul 27 12:49:58 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Deletion of /opt/stack/data/nova/instances/d1e872dc-1497-406f-97f6-539f550b20b9_del complete
Jul 27 12:49:58 user nova-compute[70994]: INFO nova.compute.manager [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 27 12:49:58 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:49:58 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:49:59 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:49:59 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Took 0.83 seconds to deallocate network for instance.
Jul 27 12:49:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:49:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:49:59 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:49:59 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:49:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:49:59 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Deleted allocations for instance d1e872dc-1497-406f-97f6-539f550b20b9
Jul 27 12:49:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-afc73a14-ab7c-41e7-8885-e790824cf1f3 tempest-VolumesActionsTest-757189479 tempest-VolumesActionsTest-757189479-project-member] Lock "d1e872dc-1497-406f-97f6-539f550b20b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] Acquiring lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] Lock "d1e872dc-1497-406f-97f6-539f550b20b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] No waiting events found dispatching network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:00 user nova-compute[70994]: WARNING nova.compute.manager [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received unexpected event network-vif-plugged-18f70eb4-30b2-4af2-8538-c12122c507e9 for instance with vm_state deleted and task_state None.
Jul 27 12:50:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e7bf56d-76b2-4775-ac75-52606f17032a req-5265c451-6c52-4b07-85c9-0fe99586c1db service nova] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Received event network-vif-deleted-18f70eb4-30b2-4af2-8538-c12122c507e9 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing instance network info cache due to event network-changed-5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:50:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:05 user nova-compute[70994]: DEBUG nova.network.neutron [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Refreshing network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:50:06 user nova-compute[70994]: DEBUG nova.network.neutron [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updated VIF entry in instance network info cache for port 5389c431-e670-4b72-9d85-ff6cf932bd22. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:50:06 user nova-compute[70994]: DEBUG nova.network.neutron [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0e73719-9c13-47bf-9d76-7022015e6ce6 req-e5c551cb-1d52-4c17-97ca-87b2fa442e38 service nova] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-changed-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Refreshing instance network info cache due to event network-changed-a65b020f-1b45-4235-95ec-22d237d2d66d. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.network.neutron [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Refreshing network info cache for port a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Stashing vm_state: active {{(pid=70994) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_requests' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:50:07 user nova-compute[70994]: INFO nova.compute.claims [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Claim successful on node user
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'resources' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'pci_devices' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:08 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating resource usage from migration ce44b824-8a73-408f-bc15-06f64347b0a2
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updated VIF entry in instance network info cache for port a65b020f-1b45-4235-95ec-22d237d2d66d. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c86f2505-faa8-4076-bbf7-2b97197e000c req-f4a66f7b-6dbd-451f-9c9a-30776a3d5b54 service nova] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.467s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:08 user nova-compute[70994]: INFO nova.compute.manager [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Migrating
Jul 27 12:50:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Starting migrate_disk_and_power_off {{(pid=70994) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:09 user nova-compute[70994]: WARNING nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state active and task_state resize_migrating.
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:09 user nova-compute[70994]: WARNING nova.compute.manager [req-9983e7d8-cbb6-47c1-a2ef-53df719a997b req-73054698-01d5-4bfc-b0b3-ec751c945c39 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state active and task_state resize_migrating.
Jul 27 12:50:09 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance destroyed successfully.
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65b020f-1b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:50:09 user nova-compute[70994]: INFO os_vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b')
Jul 27 12:50:09 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:50:09 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e0d90-1804-4a37-ba0b-b60a78edc868]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:50:09 user nova-compute[70994]: No targets found.
Jul 27 12:50:09 user nova-compute[70994]: iSNS:
Jul 27 12:50:09 user nova-compute[70994]: No targets found.
Jul 27 12:50:09 user nova-compute[70994]: STATIC:
Jul 27 12:50:09 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:50:09 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:50:09 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:50:09 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30
Jul 27 12:50:09 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:50:09 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:50:09 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad
Jul 27 12:50:09 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:50:09 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:50:09 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:50:09 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:50:09 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:50:09 user nova-compute[70994]: FIRMWARE:
Jul 27 12:50:09 user nova-compute[70994]: No targets found.
Jul 27 12:50:09 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:50:09 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:50:09 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[231993dc-4808-4061-a8f6-4a4d2a62ba8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d24183-c8d1-4264-8d1a-a62d6fecc57e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:09 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:09 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:09 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc758c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f3a17-1c8e-4e78-a186-294353baa959]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59a97a-6a70-4dc3-85ce-b4dbad30a1a8]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbbb731-c8f2-4c44-b7ac-681f7f568f55]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4a4f75-3c28-4c90-89b4-0ec814a99789]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23931653732316339', '/dev/disk/by-id/scsi-1SCST_BIO4239e28b-91e721c9f41e89cd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4239e28b') {{(pid=82465) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6c8db1-069a-4590-9875-a83a4fd00bf5]: (4, None) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:50:09 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.098s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06cf174-2e2d-4c3a-aa45-172a51de76da]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f9d5f-64e0-4f04-8453-da2b2d518bba]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]
Jul 27 12:50:10 user nova-compute[70994]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.
Jul 27 12:50:10 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10651961-8599-4dc0-a925-a012bcec54cf]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== disconnect_volume: return (382ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:50:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Port a65b020f-1b45-4235-95ec-22d237d2d66d binding to destination host user is already ACTIVE {{(pid=70994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.utils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee640bf3-def0-46a9-b938-84896fc460de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548c48b-bd7d-4811-8240-0519db74887c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4793692-da64-45b7-938d-391934e59eb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7663892c-db92-43a5-969c-de1270886eee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:50:11 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:50:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec773664-79b4-409d-9975-51944575134f]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:50:11 user nova-compute[70994]: DEBUG os_brick.utils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:50:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:13 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462198.4635096, d1e872dc-1497-406f-97f6-539f550b20b9 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:50:13 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] VM Stopped (Lifecycle Event)
Jul 27 12:50:13 user nova-compute[70994]: DEBUG nova.compute.manager [None req-255e2b34-2502-4b34-a924-83b3dc691312 None None] [instance: d1e872dc-1497-406f-97f6-539f550b20b9] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Starting finish_migration {{(pid=70994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:50:18 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Creating image(s)
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Ensure instance console log exists: /opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start _get_guest_xml network_info=[{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '537420c1-3f63-4dd9-ad48-cd5c1d8247dc', 'attached_at': '2023-07-27T12:50:18.000000', 'detached_at': '', 'volume_id': '82253e41-1032-4b7f-8b32-91176983d625', 'serial': '82253e41-1032-4b7f-8b32-91176983d625'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '85128dd3-a2ec-4e69-857e-948c52753e94', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:50:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'vcpu_model' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:50:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:50:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:50:18 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc725963-5303-4f2e-8bcc-a1f74d8f3c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:50:18 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d3917-be28-4792-91b7-0ff73dfcaf03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625] added
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14f353-5ed7-4a60-bebb-fac6520ac1d9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc8c941-d85f-428f-97e0-ed931d15a859]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsXRTqiL {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsXRTqiL" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[62daaf81-eee6-44c6-a43c-d3d42db9ad29]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsXRTqiL'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a421f-b414-4b58-9255-831d970d60b3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e72bd-2531-450f-8b71-29f1796687ea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1d93c-7709-44f2-aec3-b539f8a8c2cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]
Jul 27 12:50:18 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b666bdfc-bab9-4dfe-bbb3-0c0add68bfa9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf868348-8a88-4f2a-9ed6-2c7b105ccabd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:50:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:50:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7336436-b8c2-4d1e-a444-ca8b8566bd82]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:50:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:50:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23931653732316339', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653732316339', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:50:20 user nova-compute[70994]:   <uuid>537420c1-3f63-4dd9-ad48-cd5c1d8247dc</uuid>
Jul 27 12:50:20 user nova-compute[70994]:   <name>instance-00000019</name>
Jul 27 12:50:20 user nova-compute[70994]:   <memory>2097152</memory>
Jul 27 12:50:20 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:50:20 user nova-compute[70994]:   <metadata>
Jul 27 12:50:20 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:50:20 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:50:20 user nova-compute[70994]:       <nova:name>tempest-ServerActionsTestOtherA-server-533728173</nova:name>
Jul 27 12:50:20 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:50:18</nova:creationTime>
Jul 27 12:50:20 user nova-compute[70994]:       <nova:flavor name="m1.small">
Jul 27 12:50:20 user nova-compute[70994]:         <nova:memory>2048</nova:memory>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:disk>20</nova:disk>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:50:20 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:50:20 user nova-compute[70994]:       <nova:owner>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:user uuid="2e02d7aebd3e46beb2f554956eb3804c">tempest-ServerActionsTestOtherA-1320950418-project-member</nova:user>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:project uuid="dba79eb748dd4e26b0be6a26705bda45">tempest-ServerActionsTestOtherA-1320950418</nova:project>
Jul 27 12:50:20 user nova-compute[70994]:       </nova:owner>
Jul 27 12:50:20 user nova-compute[70994]:       <nova:ports>
Jul 27 12:50:20 user nova-compute[70994]:         <nova:port uuid="a65b020f-1b45-4235-95ec-22d237d2d66d">
Jul 27 12:50:20 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:50:20 user nova-compute[70994]:         </nova:port>
Jul 27 12:50:20 user nova-compute[70994]:       </nova:ports>
Jul 27 12:50:20 user nova-compute[70994]:     </nova:instance>
Jul 27 12:50:20 user nova-compute[70994]:   </metadata>
Jul 27 12:50:20 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:50:20 user nova-compute[70994]:     <system>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="serial">537420c1-3f63-4dd9-ad48-cd5c1d8247dc</entry>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="uuid">537420c1-3f63-4dd9-ad48-cd5c1d8247dc</entry>
Jul 27 12:50:20 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:50:20 user nova-compute[70994]:     </system>
Jul 27 12:50:20 user nova-compute[70994]:   </sysinfo>
Jul 27 12:50:20 user nova-compute[70994]:   <os>
Jul 27 12:50:20 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:50:20 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:50:20 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:50:20 user nova-compute[70994]:   </os>
Jul 27 12:50:20 user nova-compute[70994]:   <features>
Jul 27 12:50:20 user nova-compute[70994]:     <acpi/>
Jul 27 12:50:20 user nova-compute[70994]:     <apic/>
Jul 27 12:50:20 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:50:20 user nova-compute[70994]:   </features>
Jul 27 12:50:20 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:50:20 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:50:20 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:50:20 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:50:20 user nova-compute[70994]:   </clock>
Jul 27 12:50:20 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:50:20 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:50:20 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:50:20 user nova-compute[70994]:   </cpu>
Jul 27 12:50:20 user nova-compute[70994]:   <devices>
Jul 27 12:50:20 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:50:20 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:50:20 user nova-compute[70994]:       <source dev="/dev/sdd"/>
Jul 27 12:50:20 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:50:20 user nova-compute[70994]:       <serial>82253e41-1032-4b7f-8b32-91176983d625</serial>
Jul 27 12:50:20 user nova-compute[70994]:     </disk>
Jul 27 12:50:20 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:50:20 user nova-compute[70994]:       <mac address="fa:16:3e:6b:36:bb"/>
Jul 27 12:50:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:50:20 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:50:20 user nova-compute[70994]:       <target dev="tapa65b020f-1b"/>
Jul 27 12:50:20 user nova-compute[70994]:     </interface>
Jul 27 12:50:20 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:50:20 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc/console.log" append="off"/>
Jul 27 12:50:20 user nova-compute[70994]:     </serial>
Jul 27 12:50:20 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:50:20 user nova-compute[70994]:     <video>
Jul 27 12:50:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:50:20 user nova-compute[70994]:     </video>
Jul 27 12:50:20 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:50:20 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:50:20 user nova-compute[70994]:     </rng>
Jul 27 12:50:20 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:50:20 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:50:20 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:50:20 user nova-compute[70994]:     </memballoon>
Jul 27 12:50:20 user nova-compute[70994]:   </devices>
Jul 27 12:50:20 user nova-compute[70994]: </domain>
Jul 27 12:50:20 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-132702124-network", "vif_mac": "fa:16:3e:6b:36:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG os_vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65b020f-1b, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa65b020f-1b, col_values=(('external_ids', {'iface-id': 'a65b020f-1b45-4235-95ec-22d237d2d66d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:36:bb', 'vm-uuid': '537420c1-3f63-4dd9-ad48-cd5c1d8247dc'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:20 user nova-compute[70994]: INFO os_vif [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b')
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:50:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] No VIF found with MAC fa:16:3e:6b:36:bb, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:21 user nova-compute[70994]: WARNING nova.compute.manager [req-f0585849-5ada-46a9-8b44-94e0016139e0 req-6962d7f7-493e-4ace-8425-61fe7e2e3ad9 service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state active and task_state resize_finish.
Jul 27 12:50:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 537420c1-3f63-4dd9-ad48-cd5c1d8247dc due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462223.674251, 537420c1-3f63-4dd9-ad48-cd5c1d8247dc => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:50:23 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] VM Resumed (Lifecycle Event)
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:50:23 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance running successfully.
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Failed to set time: agent not configured {{(pid=70994) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e94bca28-d4a3-473b-b7f0-09dfb6bb2060 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] finish_migration finished successfully. {{(pid=70994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:50:23 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462223.6754954, 537420c1-3f63-4dd9-ad48-cd5c1d8247dc => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:50:23 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] VM Started (Lifecycle Event)
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:50:23 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:23 user nova-compute[70994]: WARNING nova.compute.manager [req-4e2cfd62-5abc-45da-b8dc-1de434214c5c req-556b68ae-a6f4-4291-9ae5-2bb4918fa7dc service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state resized and task_state None.
Jul 27 12:50:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:50:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:31 user nova-compute[70994]: INFO nova.compute.manager [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] instance snapshotting
Jul 27 12:50:31 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Beginning live snapshot process
Jul 27 12:50:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json -f qcow2 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42.delta 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42.delta 1073741824" returned: 0 in 0.052s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 12:50:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:50:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 12:50:33 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 12:50:33 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:50:33 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42.delta /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42.delta /opt/stack/data/nova/instances/snapshots/tmp2sx0wi9f/01b3b1f75fbf48818012b32dd652fd42" returned: 0 in 0.490s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:34 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Snapshot extracted, beginning image upload
Jul 27 12:50:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:34 user nova-compute[70994]: INFO nova.compute.manager [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Unshelving
Jul 27 12:50:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_requests' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'numa_topology' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:50:34 user nova-compute[70994]: INFO nova.compute.claims [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Claim successful on node user
Jul 27 12:50:34 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:50:34 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:35 user nova-compute[70994]: INFO nova.network.neutron [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating port d6633dff-0d5e-416d-a53e-46659b9dbcce with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing instance network info cache due to event network-changed-d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:50:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] Acquiring lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG nova.network.neutron [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:50:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Creating image(s)
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'trusted_certs' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] Acquired lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Refreshing network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "c7824d92c6243caa70139806898d4c54e4828c04" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "c7824d92c6243caa70139806898d4c54e4828c04" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:37 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Snapshot image upload complete
Jul 27 12:50:37 user nova-compute[70994]: INFO nova.compute.manager [None req-240786ba-1f8e-41ff-8754-cc97690d3bf5 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Took 6.13 seconds to snapshot the instance on the hypervisor.
Jul 27 12:50:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.part --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG nova.virt.images [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] d045984e-c1ab-419c-b280-a663cc46e76c was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:50:37 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.part /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updated VIF entry in instance network info cache for port d6633dff-0d5e-416d-a53e-46659b9dbcce. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG nova.network.neutron [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-02f06ee5-c8bc-4fe6-9868-12d2894d1791 req-800a7e1b-d441-4beb-815e-112d2a9bc325 service nova] Releasing lock "refresh_cache-201a7ef6-4cc0-4e56-8559-52d524bafe16" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.part /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.converted" returned: 0 in 0.568s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "c7824d92c6243caa70139806898d4c54e4828c04" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.041s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "c7824d92c6243caa70139806898d4c54e4828c04" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "c7824d92c6243caa70139806898d4c54e4828c04" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04,backing_fmt=raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04,backing_fmt=raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk 1073741824" returned: 0 in 0.052s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "c7824d92c6243caa70139806898d4c54e4828c04" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:38 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7824d92c6243caa70139806898d4c54e4828c04 --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'migration_context' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:39 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Rebasing disk image.
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 -F raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 -F raw /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk" returned: 0 in 2.265s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Ensure instance console log exists: /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start _get_guest_xml network_info=[{"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aae90cde564aff353935e221673bdb2b',container_format='bare',created_at=2023-07-27T12:48:41Z,direct_url=<?>,disk_format='qcow2',id=d045984e-c1ab-419c-b280-a663cc46e76c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-621725393-shelved',owner='0451def811f34a848fd1450763964b49',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T12:48:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:50:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:41 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aae90cde564aff353935e221673bdb2b',container_format='bare',created_at=2023-07-27T12:48:41Z,direct_url=<?>,disk_format='qcow2',id=d045984e-c1ab-419c-b280-a663cc46e76c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-621725393-shelved',owner='0451def811f34a848fd1450763964b49',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T12:48:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='d045984e-c1ab-419c-b280-a663cc46e76c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-268239023',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:48:45.922964',shelved_host='user',shelved_image_id='d045984e-c1ab-419c-b280-a663cc46e76c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'pci_devices' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:50:41 user nova-compute[70994]:   <uuid>201a7ef6-4cc0-4e56-8559-52d524bafe16</uuid>
Jul 27 12:50:41 user nova-compute[70994]:   <name>instance-00000015</name>
Jul 27 12:50:41 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:50:41 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:50:41 user nova-compute[70994]:   <metadata>
Jul 27 12:50:41 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:50:41 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-621725393</nova:name>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:50:41</nova:creationTime>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:50:41 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:50:41 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:owner>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:user uuid="5a0ba1f1c8b842c4b1067033391456ab">tempest-AttachVolumeShelveTestJSON-1527010192-project-member</nova:user>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:project uuid="0451def811f34a848fd1450763964b49">tempest-AttachVolumeShelveTestJSON-1527010192</nova:project>
Jul 27 12:50:41 user nova-compute[70994]:       </nova:owner>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:root type="image" uuid="d045984e-c1ab-419c-b280-a663cc46e76c"/>
Jul 27 12:50:41 user nova-compute[70994]:       <nova:ports>
Jul 27 12:50:41 user nova-compute[70994]:         <nova:port uuid="d6633dff-0d5e-416d-a53e-46659b9dbcce">
Jul 27 12:50:41 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:50:41 user nova-compute[70994]:         </nova:port>
Jul 27 12:50:41 user nova-compute[70994]:       </nova:ports>
Jul 27 12:50:41 user nova-compute[70994]:     </nova:instance>
Jul 27 12:50:41 user nova-compute[70994]:   </metadata>
Jul 27 12:50:41 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:50:41 user nova-compute[70994]:     <system>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="serial">201a7ef6-4cc0-4e56-8559-52d524bafe16</entry>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="uuid">201a7ef6-4cc0-4e56-8559-52d524bafe16</entry>
Jul 27 12:50:41 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:50:41 user nova-compute[70994]:     </system>
Jul 27 12:50:41 user nova-compute[70994]:   </sysinfo>
Jul 27 12:50:41 user nova-compute[70994]:   <os>
Jul 27 12:50:41 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:50:41 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:50:41 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:50:41 user nova-compute[70994]:   </os>
Jul 27 12:50:41 user nova-compute[70994]:   <features>
Jul 27 12:50:41 user nova-compute[70994]:     <acpi/>
Jul 27 12:50:41 user nova-compute[70994]:     <apic/>
Jul 27 12:50:41 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:50:41 user nova-compute[70994]:   </features>
Jul 27 12:50:41 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:50:41 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:50:41 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:50:41 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:50:41 user nova-compute[70994]:   </clock>
Jul 27 12:50:41 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:50:41 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:50:41 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:50:41 user nova-compute[70994]:   </cpu>
Jul 27 12:50:41 user nova-compute[70994]:   <devices>
Jul 27 12:50:41 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:50:41 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:50:41 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk"/>
Jul 27 12:50:41 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:50:41 user nova-compute[70994]:     </disk>
Jul 27 12:50:41 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:50:41 user nova-compute[70994]:       <mac address="fa:16:3e:f6:87:f5"/>
Jul 27 12:50:41 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:50:41 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:50:41 user nova-compute[70994]:       <target dev="tapd6633dff-0d"/>
Jul 27 12:50:41 user nova-compute[70994]:     </interface>
Jul 27 12:50:41 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:50:41 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/console.log" append="off"/>
Jul 27 12:50:41 user nova-compute[70994]:     </serial>
Jul 27 12:50:41 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:50:41 user nova-compute[70994]:     <video>
Jul 27 12:50:41 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:50:41 user nova-compute[70994]:     </video>
Jul 27 12:50:41 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:50:41 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:50:41 user nova-compute[70994]:     </rng>
Jul 27 12:50:41 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:50:41 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:50:41 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:50:41 user nova-compute[70994]:     </memballoon>
Jul 27 12:50:41 user nova-compute[70994]:   </devices>
Jul 27 12:50:41 user nova-compute[70994]: </domain>
Jul 27 12:50:41 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='d045984e-c1ab-419c-b280-a663cc46e76c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-268239023',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member',shelved_at='2023-07-27T12:48:45.922964',shelved_host='user',shelved_image_id='d045984e-c1ab-419c-b280-a663cc46e76c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG os_vif [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6633dff-0d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6633dff-0d, col_values=(('external_ids', {'iface-id': 'd6633dff-0d5e-416d-a53e-46659b9dbcce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:87:f5', 'vm-uuid': '201a7ef6-4cc0-4e56-8559-52d524bafe16'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:41 user nova-compute[70994]: INFO os_vif [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d')
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] No VIF found with MAC fa:16:3e:f6:87:f5, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:43 user nova-compute[70994]: WARNING nova.compute.manager [req-b795ae39-7cca-44f1-962f-f1c3645e59e3 req-87129fce-850c-4908-8247-10e9256b8e2b service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 12:50:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7051MB free_disk=25.189945220947266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Applying migration context for instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc as it has an incoming, in-progress migration ce44b824-8a73-408f-bc15-06f64347b0a2. Migration status is finished {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 12:50:43 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating resource usage from migration ce44b824-8a73-408f-bc15-06f64347b0a2
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 00f32d91-990e-46c2-bcbd-819391468efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Migration ce44b824-8a73-408f-bc15-06f64347b0a2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (171e9a47-00d8-4e90-9ceb-1b30c2928bd7): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1751}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:44 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:50:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:50:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:50:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462245.3180137, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:50:45 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Resumed (Lifecycle Event)
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:50:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance spawned successfully.
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:50:45 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462245.3220756, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:50:45 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Started (Lifecycle Event)
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:50:45 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:50:45 user nova-compute[70994]: WARNING nova.compute.manager [req-e9438eb6-3321-4f3e-a9fa-edf802d0d8f1 req-25d3ed53-547f-443f-a554-5a15752caf27 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 12:50:45 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:50:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f5285ea7-1412-471c-bc9d-ed0456fe4c94 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.324s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'flavor' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:50:57 user nova-compute[70994]: INFO nova.compute.manager [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attaching volume 694c3ac5-e145-443e-85c6-643ee1b3bc2b to /dev/vdb
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.utils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee44b19d-0a59-43d0-86f2-c03c470ce9eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1038a3e-8266-493d-91cc-5246fe9fd492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02db75-0ad9-4926-b09f-e9dbe7e988a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17b258-ecc5-47fa-9b78-ab4b1c85e9c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:50:57 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:50:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d43638-b468-4469-b792-3ddd1ed1b959]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG os_brick.utils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:50:57 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating existing volume attachment record: 23bb965e-d5b1-43b0-b909-d919fc9ab932 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:51:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-changed-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Refreshing instance network info cache due to event network-changed-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] Acquiring lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] Acquired lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Refreshing network info cache for port e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updated VIF entry in instance network info cache for port e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updating instance_info_cache with network_info: [{"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-101a1fb2-951c-43aa-b9c6-5cfac232c676 req-be328d2c-ebf8-48e3-b969-ebfce5898245 service nova] Releasing lock "refresh_cache-e24b9029-64dc-4b6b-ad8d-94f021bee52e" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:04 user nova-compute[70994]: INFO nova.compute.manager [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Terminating instance
Jul 27 12:51:04 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-unplugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] No waiting events found dispatching network-vif-unplugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-8d70766c-a85b-48e0-bc57-0d9f089bb877 req-b26ed95c-cef8-48b1-86ef-7325ca787978 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-unplugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Instance destroyed successfully.
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lazy-loading 'resources' on Instance uuid 00f32d91-990e-46c2-bcbd-819391468efc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-418164629',display_name='tempest-VolumesNegativeTest-instance-418164629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-418164629',id=28,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba243f600d674a72a4d1ecbb0c6429f7',ramdisk_id='',reservation_id='r-oer04v83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2123507904',owner_user_name='tempest-VolumesNegativeTest-2123507904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:49:22Z,user_data=None,user_id='26ce305dc6f8496ab27762d4ee337620',uuid=00f32d91-990e-46c2-bcbd-819391468efc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converting VIF {"id": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "address": "fa:16:3e:ff:74:32", "network": {"id": "c26064a3-311a-4420-972a-cecbf44f1b09", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e7fd047385e9404eb8feada8b898a186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c314e76-db", "ovs_interfaceid": "7c314e76-dbb5-4a6d-b100-1e63f1415df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_vif [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c314e76-db, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:05 user nova-compute[70994]: INFO os_vif [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:74:32,bridge_name='br-int',has_traffic_filtering=True,id=7c314e76-dbb5-4a6d-b100-1e63f1415df1,network=Network(c26064a3-311a-4420-972a-cecbf44f1b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c314e76-db')
Jul 27 12:51:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Deleting instance files /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc_del
Jul 27 12:51:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Deletion of /opt/stack/data/nova/instances/00f32d91-990e-46c2-bcbd-819391468efc_del complete
Jul 27 12:51:05 user nova-compute[70994]: INFO nova.compute.manager [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:51:05 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:05 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:05 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[337bff74-c9ae-4216-ac48-a43d28f9a5a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:51:05 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe94c9-e272-41eb-8755-a159e0c7211f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b] added
Jul 27 12:51:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684bfb2-e0de-475f-a043-de361f8c0b30]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bafff4-01ea-4703-9aec-7e978e7eec8d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGKFcoZn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGKFcoZn" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9040f21-a6ce-4c66-aa5b-8d88bbca283e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGKFcoZn'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b850d202-6f27-4f22-ad58-07187e32f581]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874138f-ba01-4a5c-98c1-a75882b53f4c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:51:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e14e9c-8d2f-4568-95b7-1782c42a1060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260]
Jul 27 12:51:06 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260] successful.
Jul 27 12:51:06 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6d737-3a6f-4c05-9599-20ad0f6c232f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b62f2b-d91d-40d4-99f8-98faa39f1e04]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:06 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:06 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:06 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf6c8e1-67b9-4db2-86f5-0354db73f8d6]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:06 user nova-compute[70994]: INFO nova.compute.manager [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Attaching volume 6c05e73f-93f5-4504-836d-1f6ea8923a17 to /dev/vdb
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.utils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74898801-1d4f-4685-9a09-3a57bee32c77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976f16c-c246-4d20-9f1a-87fd0decaa94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4929a812-2e4e-4649-b16d-7923836b98ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[207174ec-350e-462b-9378-531b4c2cd1ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:51:06 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a327b-5a04-4088-b8af-c35f96d9761c]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG os_brick.utils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updating existing volume attachment record: 1bc3b611-21e8-411f-aeaf-4cf0bb003f49 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:06 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Took 1.22 seconds to deallocate network for instance.
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0857f52-8c0a-4296-969a-ea4431de7c66 req-1b4890c7-a345-427e-8406-b59c8e0ed9a3 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-deleted-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:06 user nova-compute[70994]: INFO nova.compute.manager [req-c0857f52-8c0a-4296-969a-ea4431de7c66 req-1b4890c7-a345-427e-8406-b59c8e0ed9a3 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Neutron deleted interface 7c314e76-dbb5-4a6d-b100-1e63f1415df1; detaching it from the instance and deleting it from the info cache
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.network.neutron [req-c0857f52-8c0a-4296-969a-ea4431de7c66 req-1b4890c7-a345-427e-8406-b59c8e0ed9a3 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0857f52-8c0a-4296-969a-ea4431de7c66 req-1b4890c7-a345-427e-8406-b59c8e0ed9a3 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Detach interface failed, port_id=7c314e76-dbb5-4a6d-b100-1e63f1415df1, reason: Instance 00f32d91-990e-46c2-bcbd-819391468efc could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] Acquiring lock "00f32d91-990e-46c2-bcbd-819391468efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] Lock "00f32d91-990e-46c2-bcbd-819391468efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] No waiting events found dispatching network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:06 user nova-compute[70994]: WARNING nova.compute.manager [req-e7ee79b4-480d-4d22-ba62-789a8a9d6be9 req-12861b93-cbde-44b3-aab1-3b78b3c70871 service nova] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Received unexpected event network-vif-plugged-7c314e76-dbb5-4a6d-b100-1e63f1415df1 for instance with vm_state active and task_state deleting.
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23031326337383564', 'path': '/dev/sdg'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031326337383564', 'path': '/dev/sdg'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'flavor' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:51:07 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:51:07 user nova-compute[70994]:   <source dev="/dev/sdg"/>
Jul 27 12:51:07 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:51:07 user nova-compute[70994]:   <serial>694c3ac5-e145-443e-85c6-643ee1b3bc2b</serial>
Jul 27 12:51:07 user nova-compute[70994]: </disk>
Jul 27 12:51:07 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:51:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.219s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No VIF found with MAC fa:16:3e:44:3f:08, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:51:08 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Deleted allocations for instance 00f32d91-990e-46c2-bcbd-819391468efc
Jul 27 12:51:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d67abb8b-410b-45e0-9aa7-19931b9385ec tempest-VolumesNegativeTest-2123507904 tempest-VolumesNegativeTest-2123507904-project-member] Lock "00f32d91-990e-46c2-bcbd-819391468efc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.495s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b37227af-000d-4a2d-b888-1bfc3fa71c89 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.460s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:10 user nova-compute[70994]: INFO nova.compute.manager [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Rescuing
Jul 27 12:51:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG nova.network.neutron [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:11 user nova-compute[70994]: WARNING nova.compute.manager [req-25837b10-c9e7-4f47-8e91-a1545dd4e416 req-55f6c95e-03ac-4809-9bb1-e164c18b99ed service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state active and task_state rescuing.
Jul 27 12:51:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance destroyed successfully.
Jul 27 12:51:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attempting a stable device rescue
Jul 27 12:51:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:51:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Creating image(s)
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "ca0d974faed34544888de0f2193da6f0392bd844" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "ca0d974faed34544888de0f2193da6f0392bd844" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.part --force-share --output=json" returned: 0 in 0.184s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG nova.virt.images [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] d8aeb13f-760d-4ee7-8519-6de8a7f45966 was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.part /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.part /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.converted" returned: 0 in 0.351s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:13 user nova-compute[70994]: WARNING nova.compute.manager [req-c0d633a1-6a00-43cb-a171-f32f1cf0dabd req-9e6cdbd7-9891-4f92-bd94-f4413b502855 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state active and task_state rescuing.
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "ca0d974faed34544888de0f2193da6f0392bd844" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.645s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "ca0d974faed34544888de0f2193da6f0392bd844" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "ca0d974faed34544888de0f2193da6f0392bd844" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844 --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844,backing_fmt=raw /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca0d974faed34544888de0f2193da6f0392bd844,backing_fmt=raw /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue" returned: 0 in 0.072s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "ca0d974faed34544888de0f2193da6f0392bd844" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'migration_context' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start _get_guest_xml network_info=[{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "vif_mac": "fa:16:3e:44:3f:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd8aeb13f-760d-4ee7-8519-6de8a7f45966', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f9432eac-732b-4dcc-b8af-abb390b7cb55', 'attached_at': '', 'detached_at': '', 'volume_id': '694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'serial': '694c3ac5-e145-443e-85c6-643ee1b3bc2b'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '23bb965e-d5b1-43b0-b909-d919fc9ab932', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'resources' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'numa_topology' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:13 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:13 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:51:13 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:13 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:13 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1184ef6-21c4-4284-81dd-4c4f607513e6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sGKFcoZn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 12:51:13 user nova-compute[70994]: node.name = iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b
Jul 27 12:51:13 user nova-compute[70994]: node.tpgt = -1
Jul 27 12:51:13 user nova-compute[70994]: node.startup = automatic
Jul 27 12:51:13 user nova-compute[70994]: node.leading_login = No
Jul 27 12:51:13 user nova-compute[70994]: iface.iscsi_ifacename = default
Jul 27 12:51:13 user nova-compute[70994]: iface.net_ifacename = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.ipaddress = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.prefix_len = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.hwaddress = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.transport_name = tcp
Jul 27 12:51:13 user nova-compute[70994]: iface.initiatorname = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.vlan_id = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.vlan_priority = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.vlan_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.iface_num = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.mtu = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.port = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.bootproto = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.subnet_mask = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.gateway = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_alt_client_id = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_dns = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_learn_iqn = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_vendor_id_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_vendor_id = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.dhcp_slp_da = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.fragmentation = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.gratuitous_arp = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.incoming_forwarding = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.tos_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.tos = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.ttl = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.delayed_ack = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.tcp_nagle = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.tcp_wsf_state = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.tcp_wsf = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.tcp_timer_scale = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.tcp_timestamp = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.redirect = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.def_task_mgmt_timeout = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.header_digest = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.data_digest = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.immediate_data = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.initial_r2t = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.data_seq_inorder = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.data_pdu_inorder = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.erl = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.max_receive_data_len = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.first_burst_len = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.max_outstanding_r2t = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.max_burst_len = 0
Jul 27 12:51:13 user nova-compute[70994]: iface.chap_auth = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.bidi_chap = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.strict_login_compliance = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.discovery_auth = <empty>
Jul 27 12:51:13 user nova-compute[70994]: iface.discovery_logout = <empty>
Jul 27 12:51:13 user nova-compute[70994]: node.discovery_address = <empty>
Jul 27 12:51:13 user nova-compute[70994]: node.discovery_port = 0
Jul 27 12:51:13 user nova-compute[70994]: node.discovery_type = static
Jul 27 12:51:13 user nova-compute[70994]: node.session.initial_cmdsn = 0
Jul 27 12:51:13 user nova-compute[70994]: node.session.initial_login_retry_max = 8
Jul 27 12:51:13 user nova-compute[70994]: node.session.xmit_thread_priority = -20
Jul 27 12:51:13 user nova-compute[70994]: node.session.cmds_max = 128
Jul 27 12:51:13 user nova-compute[70994]: node.session.queue_depth = 32
Jul 27 12:51:13 user nova-compute[70994]: node.session.nr_sessions = 1
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.authmethod = CHAP
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.username = sGKFcoZn
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.password = ***
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.username_in = <empty>
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.password_in = <empty>
Jul 27 12:51:13 user nova-compute[70994]: node.session.auth.chap_algs = MD5
Jul 27 12:51:13 user nova-compute[70994]: node.session.timeo.replacement_timeout = 120
Jul 27 12:51:13 user nova-compute[70994]: node.session.err_timeo.abort_timeout = 15
Jul 27 12:51:13 user nova-compute[70994]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 12:51:13 user nova-compute[70994]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 12:51:13 user nova-compute[70994]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.FastAbort = Yes
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.InitialR2T = No
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.ImmediateData = Yes
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.MaxConnections = 1
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 12:51:13 user nova-compute[70994]: node.session.iscsi.ERL = 0
Jul 27 12:51:13 user nova-compute[70994]: node.session.scan = manual
Jul 27 12:51:13 user nova-compute[70994]: node.session.reopen_max = 0
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].address = 172.16.0.220
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].port = 3260
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].startup = manual
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].tcp.window_size = 524288
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].tcp.type_of_service = 0
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].timeo.logout_timeout = 15
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].timeo.login_timeout = 15
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].timeo.auth_timeout = 45
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.DataDigest = None
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.IFMarker = No
Jul 27 12:51:13 user nova-compute[70994]: node.conn[0].iscsi.OFMarker = No
Jul 27 12:51:13 user nova-compute[70994]: # END RECORD
Jul 27 12:51:13 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e000053-303d-4c9f-b069-85b8b03e4944]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b743db30-bd9f-44f1-aac7-b635c0eb46b4]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGKFcoZn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGKFcoZn" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5221f0bf-777a-4334-b962-80d2628274e9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGKFcoZn'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f2b87c-167e-43e0-902e-ad80df4f992e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8823b505-cd8d-489b-b7b3-3e4877940bca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:13 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:13 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:13 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] HCTL ('38', '0', '0', 0) found on session 29 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1311c90-2916-4a0e-8c4e-e931d06077ed]: (4, ('0 0 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Searching for a device in session 29 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.217s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] <== connect_volume: return (218ms) {'type': 'block', 'scsi_wwn': '23031326337383564', 'path': '/dev/sdg'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031326337383564', 'path': '/dev/sdg'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1006968374',display_name='tempest-ServerStableDeviceRescueTest-server-1006968374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1006968374',id=22,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9cAQdEUwCjJ5NO/sU7pixKf7Ep1zH+79GJq+9pKHMOmoNI5F/OrHSlARsbOP9FjCl/CzuGGo0+IHt60ofxd4AqnC0785A6FFyW+GyYs7Je9M0sRHs9yyg058u3CDXiMQ==',key_name='tempest-keypair-1267023795',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf2ec7ac6ff456eb3ef1f52241a742e',ramdisk_id='',reservation_id='r-d3aagtse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-373928889',owner_user_name='tempest-ServerStableDeviceRescueTest-373928889-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f8edd1555a642b8b776aa6d329a1eaa',uuid=f9432eac-732b-4dcc-b8af-abb390b7cb55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "vif_mac": "fa:16:3e:44:3f:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converting VIF {"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "vif_mac": "fa:16:3e:44:3f:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:51:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'pci_devices' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:51:14 user nova-compute[70994]:   <uuid>f9432eac-732b-4dcc-b8af-abb390b7cb55</uuid>
Jul 27 12:51:14 user nova-compute[70994]:   <name>instance-00000016</name>
Jul 27 12:51:14 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:51:14 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:51:14 user nova-compute[70994]:   <metadata>
Jul 27 12:51:14 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:51:14 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1006968374</nova:name>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:51:13</nova:creationTime>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:51:14 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:51:14 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:owner>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:user uuid="4f8edd1555a642b8b776aa6d329a1eaa">tempest-ServerStableDeviceRescueTest-373928889-project-member</nova:user>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:project uuid="1bf2ec7ac6ff456eb3ef1f52241a742e">tempest-ServerStableDeviceRescueTest-373928889</nova:project>
Jul 27 12:51:14 user nova-compute[70994]:       </nova:owner>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:51:14 user nova-compute[70994]:       <nova:ports>
Jul 27 12:51:14 user nova-compute[70994]:         <nova:port uuid="33013b4d-599e-46b0-9f2d-446217b3e442">
Jul 27 12:51:14 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:51:14 user nova-compute[70994]:         </nova:port>
Jul 27 12:51:14 user nova-compute[70994]:       </nova:ports>
Jul 27 12:51:14 user nova-compute[70994]:     </nova:instance>
Jul 27 12:51:14 user nova-compute[70994]:   </metadata>
Jul 27 12:51:14 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:51:14 user nova-compute[70994]:     <system>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="serial">f9432eac-732b-4dcc-b8af-abb390b7cb55</entry>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="uuid">f9432eac-732b-4dcc-b8af-abb390b7cb55</entry>
Jul 27 12:51:14 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:51:14 user nova-compute[70994]:     </system>
Jul 27 12:51:14 user nova-compute[70994]:   </sysinfo>
Jul 27 12:51:14 user nova-compute[70994]:   <os>
Jul 27 12:51:14 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:51:14 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:51:14 user nova-compute[70994]:   </os>
Jul 27 12:51:14 user nova-compute[70994]:   <features>
Jul 27 12:51:14 user nova-compute[70994]:     <acpi/>
Jul 27 12:51:14 user nova-compute[70994]:     <apic/>
Jul 27 12:51:14 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:51:14 user nova-compute[70994]:   </features>
Jul 27 12:51:14 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:51:14 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:51:14 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:51:14 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:51:14 user nova-compute[70994]:   </clock>
Jul 27 12:51:14 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:51:14 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:51:14 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:51:14 user nova-compute[70994]:   </cpu>
Jul 27 12:51:14 user nova-compute[70994]:   <devices>
Jul 27 12:51:14 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:51:14 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:51:14 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk"/>
Jul 27 12:51:14 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:51:14 user nova-compute[70994]:     </disk>
Jul 27 12:51:14 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:51:14 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:51:14 user nova-compute[70994]:       <source dev="/dev/sdg"/>
Jul 27 12:51:14 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:51:14 user nova-compute[70994]:       <serial>694c3ac5-e145-443e-85c6-643ee1b3bc2b</serial>
Jul 27 12:51:14 user nova-compute[70994]:     </disk>
Jul 27 12:51:14 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:51:14 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:51:14 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue"/>
Jul 27 12:51:14 user nova-compute[70994]:       <target dev="vdc" bus="virtio"/>
Jul 27 12:51:14 user nova-compute[70994]:       <boot order="1"/>
Jul 27 12:51:14 user nova-compute[70994]:     </disk>
Jul 27 12:51:14 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:51:14 user nova-compute[70994]:       <mac address="fa:16:3e:44:3f:08"/>
Jul 27 12:51:14 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:51:14 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:51:14 user nova-compute[70994]:       <target dev="tap33013b4d-59"/>
Jul 27 12:51:14 user nova-compute[70994]:     </interface>
Jul 27 12:51:14 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:51:14 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/console.log" append="off"/>
Jul 27 12:51:14 user nova-compute[70994]:     </serial>
Jul 27 12:51:14 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:51:14 user nova-compute[70994]:     <video>
Jul 27 12:51:14 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:51:14 user nova-compute[70994]:     </video>
Jul 27 12:51:14 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:51:14 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:51:14 user nova-compute[70994]:     </rng>
Jul 27 12:51:14 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:51:14 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:51:14 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:51:14 user nova-compute[70994]:     </memballoon>
Jul 27 12:51:14 user nova-compute[70994]:   </devices>
Jul 27 12:51:14 user nova-compute[70994]: </domain>
Jul 27 12:51:14 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:51:14 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance destroyed successfully.
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] No VIF found with MAC fa:16:3e:44:3f:08, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsMQqhJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:51:14 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:14 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:51:14 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdabdb-706c-4e74-adfd-92f599f7d773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:51:14 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82986db8-b504-4273-9735-d2bd2edda15d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17] added
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c25055d-c9d2-4963-bdd2-f53bb334787e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fecd17c-b31e-418c-9fd3-93b149397fd2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsMQqhJB {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsMQqhJB" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9e3eb-f1a5-44af-ad85-43146c668088]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsMQqhJB'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb6fbb-8543-4d95-a5b5-b8a986c7d8f7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea732c-5766-43d4-aca3-d45c798e80bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae00612-471c-498f-9961-9d3f848cdc6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260]
Jul 27 12:51:14 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260] successful.
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a04ab-b495-4ef1-a5a8-824ae1e05b6b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb34e88-b9df-4b61-9e13-c048b7268d6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a1c3cbc-e88f-469e-954f-83d85368c978 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:51:14 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:51:14 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b028b1-7bfa-4c42-abf2-d051dc6fb7b0]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:51:14 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsMQqhJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26633316666363438', 'path': '/dev/sdh'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633316666363438', 'path': '/dev/sdh'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:51:15 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:51:15 user nova-compute[70994]:   <source dev="/dev/sdh"/>
Jul 27 12:51:15 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:51:15 user nova-compute[70994]:   <serial>6c05e73f-93f5-4504-836d-1f6ea8923a17</serial>
Jul 27 12:51:15 user nova-compute[70994]: </disk>
Jul 27 12:51:15 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:15 user nova-compute[70994]: WARNING nova.compute.manager [req-479fb108-08d2-4bb7-bcab-edc6896c0367 req-50fee6af-f713-4b77-9f35-00d29d67f26d service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state active and task_state rescuing.
Jul 27 12:51:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:a0:be:5b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:51:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f7be9d1f-d6df-408f-8121-698c993051ac tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.959s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:17 user nova-compute[70994]: WARNING nova.compute.manager [req-838659d6-1d09-4e70-a82d-4cf1a8407edc req-54198e53-39bc-40a8-8efc-f1bcaa400da6 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state active and task_state rescuing.
Jul 27 12:51:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for f9432eac-732b-4dcc-b8af-abb390b7cb55 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462278.159191, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:18 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Resumed (Lifecycle Event)
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-509545cd-be9f-411b-bc15-3539f0837041 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:18 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462278.1602666, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:18 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Started (Lifecycle Event)
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462265.3010304, 00f32d91-990e-46c2-bcbd-819391468efc => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:20 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] VM Stopped (Lifecycle Event)
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e198cc2e-5318-4562-8043-51c56fba7e40 None None] [instance: 00f32d91-990e-46c2-bcbd-819391468efc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:51:20 user nova-compute[70994]: INFO nova.compute.claims [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Claim successful on node user
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:51:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.policy [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f01edb66ab454f91812588fe77761874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620a0246ab1483d95c9f00fe7911b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:51:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Creating image(s)
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "/opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk 1073741824" returned: 0 in 0.056s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Cannot resize image /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'migration_context' on Instance uuid 458795b5-f71d-4459-869a-e59a967bba09 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Ensure instance console log exists: /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Successfully created port: f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Successfully updated port: f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquired lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-changed-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Refreshing instance network info cache due to event network-changed-f9767de3-e268-41c7-ab74-7a7e7de32ea6. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] Acquiring lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:22 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.neutron [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updating instance_info_cache with network_info: [{"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Releasing lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Instance network_info: |[{"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] Acquired lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Refreshing network info cache for port f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Start _get_guest_xml network_info=[{"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:51:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:23 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262119528',display_name='tempest-AttachVolumeNegativeTest-server-262119528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262119528',id=29,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6Kf5hYCRxaCY3Zj3ExbSaBfgG4Tk1BgGcNFGGi2FDgDN+iPLznWQa4anhsjVwbskaFK8HcH9b0NAImB27kkmL9s5AdDmkbk/3od1M0553PMhg7udt7+ilAEoTdTgGYsQ==',key_name='tempest-keypair-706608618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-hwwj1h94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=458795b5-f71d-4459-869a-e59a967bba09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'pci_devices' on Instance uuid 458795b5-f71d-4459-869a-e59a967bba09 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:51:23 user nova-compute[70994]:   <uuid>458795b5-f71d-4459-869a-e59a967bba09</uuid>
Jul 27 12:51:23 user nova-compute[70994]:   <name>instance-0000001d</name>
Jul 27 12:51:23 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:51:23 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:51:23 user nova-compute[70994]:   <metadata>
Jul 27 12:51:23 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:51:23 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-262119528</nova:name>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:51:23</nova:creationTime>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:51:23 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:51:23 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:owner>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:user uuid="f01edb66ab454f91812588fe77761874">tempest-AttachVolumeNegativeTest-1889965975-project-member</nova:user>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:project uuid="b620a0246ab1483d95c9f00fe7911b14">tempest-AttachVolumeNegativeTest-1889965975</nova:project>
Jul 27 12:51:23 user nova-compute[70994]:       </nova:owner>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:51:23 user nova-compute[70994]:       <nova:ports>
Jul 27 12:51:23 user nova-compute[70994]:         <nova:port uuid="f9767de3-e268-41c7-ab74-7a7e7de32ea6">
Jul 27 12:51:23 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 12:51:23 user nova-compute[70994]:         </nova:port>
Jul 27 12:51:23 user nova-compute[70994]:       </nova:ports>
Jul 27 12:51:23 user nova-compute[70994]:     </nova:instance>
Jul 27 12:51:23 user nova-compute[70994]:   </metadata>
Jul 27 12:51:23 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:51:23 user nova-compute[70994]:     <system>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="serial">458795b5-f71d-4459-869a-e59a967bba09</entry>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="uuid">458795b5-f71d-4459-869a-e59a967bba09</entry>
Jul 27 12:51:23 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:51:23 user nova-compute[70994]:     </system>
Jul 27 12:51:23 user nova-compute[70994]:   </sysinfo>
Jul 27 12:51:23 user nova-compute[70994]:   <os>
Jul 27 12:51:23 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:51:23 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:51:23 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:51:23 user nova-compute[70994]:   </os>
Jul 27 12:51:23 user nova-compute[70994]:   <features>
Jul 27 12:51:23 user nova-compute[70994]:     <acpi/>
Jul 27 12:51:23 user nova-compute[70994]:     <apic/>
Jul 27 12:51:23 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:51:23 user nova-compute[70994]:   </features>
Jul 27 12:51:23 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:51:23 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:51:23 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:51:23 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:51:23 user nova-compute[70994]:   </clock>
Jul 27 12:51:23 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:51:23 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:51:23 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:51:23 user nova-compute[70994]:   </cpu>
Jul 27 12:51:23 user nova-compute[70994]:   <devices>
Jul 27 12:51:23 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:51:23 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:51:23 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk"/>
Jul 27 12:51:23 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:51:23 user nova-compute[70994]:     </disk>
Jul 27 12:51:23 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:51:23 user nova-compute[70994]:       <mac address="fa:16:3e:da:8f:a8"/>
Jul 27 12:51:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:51:23 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:51:23 user nova-compute[70994]:       <target dev="tapf9767de3-e2"/>
Jul 27 12:51:23 user nova-compute[70994]:     </interface>
Jul 27 12:51:23 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:51:23 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/console.log" append="off"/>
Jul 27 12:51:23 user nova-compute[70994]:     </serial>
Jul 27 12:51:23 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:51:23 user nova-compute[70994]:     <video>
Jul 27 12:51:23 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:51:23 user nova-compute[70994]:     </video>
Jul 27 12:51:23 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:51:23 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:51:23 user nova-compute[70994]:     </rng>
Jul 27 12:51:23 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:51:23 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:51:23 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:51:23 user nova-compute[70994]:     </memballoon>
Jul 27 12:51:23 user nova-compute[70994]:   </devices>
Jul 27 12:51:23 user nova-compute[70994]: </domain>
Jul 27 12:51:23 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262119528',display_name='tempest-AttachVolumeNegativeTest-server-262119528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262119528',id=29,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6Kf5hYCRxaCY3Zj3ExbSaBfgG4Tk1BgGcNFGGi2FDgDN+iPLznWQa4anhsjVwbskaFK8HcH9b0NAImB27kkmL9s5AdDmkbk/3od1M0553PMhg7udt7+ilAEoTdTgGYsQ==',key_name='tempest-keypair-706608618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-hwwj1h94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=458795b5-f71d-4459-869a-e59a967bba09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG os_vif [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9767de3-e2, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9767de3-e2, col_values=(('external_ids', {'iface-id': 'f9767de3-e268-41c7-ab74-7a7e7de32ea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:8f:a8', 'vm-uuid': '458795b5-f71d-4459-869a-e59a967bba09'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:23 user nova-compute[70994]: INFO os_vif [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2')
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:da:8f:a8, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updated VIF entry in instance network info cache for port f9767de3-e268-41c7-ab74-7a7e7de32ea6. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updating instance_info_cache with network_info: [{"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d55fd8b2-36f5-4b36-8897-1b0956315688 req-975501e7-9fb6-41f1-8275-c13cabd27573 service nova] Releasing lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] No waiting events found dispatching network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:25 user nova-compute[70994]: WARNING nova.compute.manager [req-35bcb6f5-7727-4b21-93d5-add91c870b8e req-06b6b12f-1014-4828-a9c3-67515128cf17 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received unexpected event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 for instance with vm_state building and task_state spawning.
Jul 27 12:51:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462287.0223775, 458795b5-f71d-4459-869a-e59a967bba09 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] VM Resumed (Lifecycle Event)
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Instance spawned successfully.
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462287.0254476, 458795b5-f71d-4459-869a-e59a967bba09 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] VM Started (Lifecycle Event)
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] No waiting events found dispatching network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:27 user nova-compute[70994]: WARNING nova.compute.manager [req-2ca671bd-ae5e-46cc-b8ba-6f6850647b71 req-a9b45acd-6e06-4ae9-941c-01a66ea45734 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received unexpected event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 for instance with vm_state building and task_state spawning.
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Took 5.99 seconds to spawn the instance on the hypervisor.
Jul 27 12:51:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:51:27 user nova-compute[70994]: INFO nova.compute.manager [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Took 6.82 seconds to build instance.
Jul 27 12:51:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-fafbc108-25fa-40b2-b8ef-55e72c267b28 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.924s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [{"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-7ae0f3cc-df1c-4427-9ab7-c7f0171de791" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:51:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:37 user nova-compute[70994]: INFO nova.compute.manager [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Unrescuing
Jul 27 12:51:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:37 user nova-compute[70994]: DEBUG nova.network.neutron [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG nova.network.neutron [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG nova.objects.instance [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'flavor' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG nova.compute.manager [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:39 user nova-compute[70994]: WARNING nova.compute.manager [req-e026b2de-61b6-494b-8fe0-a03bc15547f9 req-5c637d63-a1fc-40e9-9cbf-7641968fae44 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:51:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:51:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:39 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance destroyed successfully.
Jul 27 12:51:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:41 user nova-compute[70994]: WARNING nova.compute.manager [req-0952918e-a8d6-4c7a-896c-977f2726417d req-e69e67bd-7f15-455c-bc48-caaade53a37a service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:51:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:43 user nova-compute[70994]: WARNING nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:51:43 user nova-compute[70994]: WARNING nova.compute.manager [req-4bb8eae6-421b-4a70-b406-2d7eada2143f req-1d7b204d-524f-4a45-83d9-b02649e3f76b service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for b5a77277-e67a-4d4f-9203-36ec4040f373 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462303.404093, b5a77277-e67a-4d4f-9203-36ec4040f373 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Resumed (Lifecycle Event)
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-caadb4ec-5b83-4557-a1d9-78cd1fe976ea tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462303.4050727, b5a77277-e67a-4d4f-9203-36ec4040f373 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:51:43 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Started (Lifecycle Event)
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:51:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:51:46 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:46 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7128MB free_disk=25.186725616455078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Applying migration context for instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc as it has an incoming, in-progress migration ce44b824-8a73-408f-bc15-06f64347b0a2. Migration status is finished {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 12:51:46 user nova-compute[70994]: INFO nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating resource usage from migration ce44b824-8a73-408f-bc15-06f64347b0a2
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f57d289e-51df-412e-89ef-2698eef4453c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Migration ce44b824-8a73-408f-bc15-06f64347b0a2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 201a7ef6-4cc0-4e56-8559-52d524bafe16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 458795b5-f71d-4459-869a-e59a967bba09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:51:46 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:51:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:51:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:51:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:51:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:51:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:51:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Going to confirm migration 2 {{(pid=70994) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 27 12:51:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:51:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:51:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:51:58 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:51:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'info_cache' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG nova.network.neutron [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'migration_context' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:51:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.491s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:51:59 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Deleted allocation for migration ce44b824-8a73-408f-bc15-06f64347b0a2
Jul 27 12:51:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e712e9d4-a5c7-48eb-81bd-678643fa8bc7 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.336s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:01 user nova-compute[70994]: INFO nova.compute.manager [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Terminating instance
Jul 27 12:52:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-e4c70ae9-ba15-4925-b757-dbe421063402 req-0aea408c-10c9-4f46-8e83-72f98ec335d8 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-unplugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:52:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Instance destroyed successfully.
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lazy-loading 'resources' on Instance uuid f57d289e-51df-412e-89ef-2698eef4453c {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1698964685',display_name='tempest-ServerActionsTestOtherB-server-1698964685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1698964685',id=18,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbN09cyfiYc+rs+Hc9ce7t22S8lEmLd+J0lodKO6BQaGqAsG1Wef7BJMuSACIsaRvX29qHu47UfOvuVGLizAklBSNpAA+3PVagI0WforTOxA0X+ctoi+qXVuydyxaeEAg==',key_name='tempest-keypair-280343706',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df70a3a511c2416994b9b5864f29a387',ramdisk_id='',reservation_id='r-0egoe089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-413140038',owner_user_name='tempest-ServerActionsTestOtherB-413140038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:49:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='300a2b66d5aa4551ba7a35107feb15f0',uuid=f57d289e-51df-412e-89ef-2698eef4453c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converting VIF {"id": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "address": "fa:16:3e:6f:65:65", "network": {"id": "cc6a9ab4-4188-4942-8aa4-4e46112e3975", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-778208627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df70a3a511c2416994b9b5864f29a387", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418446e-e2", "ovs_interfaceid": "3418446e-e2a1-4516-a37e-be94d79fbf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_vif [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3418446e-e2, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:52:02 user nova-compute[70994]: INFO os_vif [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:65:65,bridge_name='br-int',has_traffic_filtering=True,id=3418446e-e2a1-4516-a37e-be94d79fbf4f,network=Network(cc6a9ab4-4188-4942-8aa4-4e46112e3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418446e-e2')
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pywhkVTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:52:02 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ce95e-3478-4f68-9d90-d831027db552]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:52:02 user nova-compute[70994]: No targets found.
Jul 27 12:52:02 user nova-compute[70994]: iSNS:
Jul 27 12:52:02 user nova-compute[70994]: No targets found.
Jul 27 12:52:02 user nova-compute[70994]: STATIC:
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:52:02 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:52:02 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:52:02 user nova-compute[70994]: FIRMWARE:
Jul 27 12:52:02 user nova-compute[70994]: No targets found.
Jul 27 12:52:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:52:02 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:52:02 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45979f33-4683-448d-ae4f-cc20a9a93ef0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[707757fa-792f-4bc8-a5a8-080071aa1c1a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:02 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4303250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671cf1f-9bd1-4060-a41b-1b3ebac81cca]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c8a41-73fd-489b-ac80-908011b18210]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411c7a5-c44b-4ae6-8e3a-dfe7bdb84f10]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd3fdae-f5e8-4c94-a665-eb3af4aba900]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd63fa3c-446e-4d92-a4cd-15d98a3a33e3]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc930373-6831-4451-a11a-0725d0a0d790]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260]
Jul 27 12:52:02 user nova-compute[70994]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad, portal: 172.16.0.220,3260] successful.
Jul 27 12:52:02 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b2870d-2ead-4d82-a0d1-760a0eb7e0ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e994a70-678c-4d2a-a2eb-c90aedcc5191]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] <== disconnect_volume: return (357ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:52:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Deleting instance files /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_del
Jul 27 12:52:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Deletion of /opt/stack/data/nova/instances/f57d289e-51df-412e-89ef-2698eef4453c_del complete
Jul 27 12:52:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:02 user nova-compute[70994]: INFO nova.compute.manager [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Took 1.40 seconds to destroy the instance on the hypervisor.
Jul 27 12:52:02 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:52:02 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:52:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] Acquiring lock "f57d289e-51df-412e-89ef-2698eef4453c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] Lock "f57d289e-51df-412e-89ef-2698eef4453c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] No waiting events found dispatching network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:03 user nova-compute[70994]: WARNING nova.compute.manager [req-c7d2c555-4683-4845-8be3-afa8ef284df4 req-b71e5813-c075-4a41-88f8-db767b98ce9c service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received unexpected event network-vif-plugged-3418446e-e2a1-4516-a37e-be94d79fbf4f for instance with vm_state active and task_state deleting.
Jul 27 12:52:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-0b95f5ab-e8fa-45b9-b065-10f92765f0b2 req-437405d7-ed6e-4831-9b4c-6486bb691ab7 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Received event network-vif-deleted-3418446e-e2a1-4516-a37e-be94d79fbf4f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:04 user nova-compute[70994]: INFO nova.compute.manager [req-0b95f5ab-e8fa-45b9-b065-10f92765f0b2 req-437405d7-ed6e-4831-9b4c-6486bb691ab7 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Neutron deleted interface 3418446e-e2a1-4516-a37e-be94d79fbf4f; detaching it from the instance and deleting it from the info cache
Jul 27 12:52:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-0b95f5ab-e8fa-45b9-b065-10f92765f0b2 req-437405d7-ed6e-4831-9b4c-6486bb691ab7 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:04 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:04 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Took 1.15 seconds to deallocate network for instance.
Jul 27 12:52:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-0b95f5ab-e8fa-45b9-b065-10f92765f0b2 req-437405d7-ed6e-4831-9b4c-6486bb691ab7 service nova] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Detach interface failed, port_id=3418446e-e2a1-4516-a37e-be94d79fbf4f, reason: Instance f57d289e-51df-412e-89ef-2698eef4453c could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:52:04 user nova-compute[70994]: INFO nova.compute.manager [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Took 0.71 seconds to detach 1 volumes for instance.
Jul 27 12:52:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:05 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:05 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:05 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Deleted allocations for instance f57d289e-51df-412e-89ef-2698eef4453c
Jul 27 12:52:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0dda4472-14af-4398-9758-1f8cda834c3d tempest-ServerActionsTestOtherB-413140038 tempest-ServerActionsTestOtherB-413140038-project-member] Lock "f57d289e-51df-412e-89ef-2698eef4453c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.879s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:17 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462322.406128, f57d289e-51df-412e-89ef-2698eef4453c => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:17 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f57d289e-51df-412e-89ef-2698eef4453c] VM Stopped (Lifecycle Event)
Jul 27 12:52:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-11bf2dc9-ddbd-47bc-839c-db215e45bcb5 None None] [instance: f57d289e-51df-412e-89ef-2698eef4453c] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:23 user nova-compute[70994]: INFO nova.compute.manager [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Terminating instance
Jul 27 12:52:23 user nova-compute[70994]: DEBUG nova.compute.manager [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:52:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-a4e0e3c7-8d20-4d53-a258-b3284a647e77 req-4cbb0cf3-8add-4f67-931c-cc362cb6adb9 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-unplugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:52:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Instance destroyed successfully.
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.objects.instance [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lazy-loading 'resources' on Instance uuid 201a7ef6-4cc0-4e56-8559-52d524bafe16 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-621725393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-621725393',id=21,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8fiHOQb+lEJ5NUA0fNEH0ky8zAYxfDHFHtM8YUbsyNxEzIOdAk+tEYGZJU7rhlBemvGXf562vSJkaqPZ7ThpO/Brhtg2ISN6Zs/H9G1Ta9yOa/SDi2saFOggL4b5jKaQ==',key_name='tempest-keypair-268239023',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0451def811f34a848fd1450763964b49',ramdisk_id='',reservation_id='r-5tmh4nzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1527010192',owner_user_name='tempest-AttachVolumeShelveTestJSON-1527010192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a0ba1f1c8b842c4b1067033391456ab',uuid=201a7ef6-4cc0-4e56-8559-52d524bafe16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converting VIF {"id": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "address": "fa:16:3e:f6:87:f5", "network": {"id": "cd38828f-187f-48b2-890e-0dcfb33f245c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1689000408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0451def811f34a848fd1450763964b49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6633dff-0d", "ovs_interfaceid": "d6633dff-0d5e-416d-a53e-46659b9dbcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG os_vif [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6633dff-0d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:52:24 user nova-compute[70994]: INFO os_vif [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:87:f5,bridge_name='br-int',has_traffic_filtering=True,id=d6633dff-0d5e-416d-a53e-46659b9dbcce,network=Network(cd38828f-187f-48b2-890e-0dcfb33f245c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6633dff-0d')
Jul 27 12:52:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Deleting instance files /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16_del
Jul 27 12:52:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Deletion of /opt/stack/data/nova/instances/201a7ef6-4cc0-4e56-8559-52d524bafe16_del complete
Jul 27 12:52:24 user nova-compute[70994]: INFO nova.compute.manager [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 27 12:52:24 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:52:24 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-9ac1764a-40c4-4698-87fe-69886b21abf2 req-5f89112b-15f9-4b46-85d3-90cad20b44f8 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-deleted-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:25 user nova-compute[70994]: INFO nova.compute.manager [req-9ac1764a-40c4-4698-87fe-69886b21abf2 req-5f89112b-15f9-4b46-85d3-90cad20b44f8 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Neutron deleted interface d6633dff-0d5e-416d-a53e-46659b9dbcce; detaching it from the instance and deleting it from the info cache
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.network.neutron [req-9ac1764a-40c4-4698-87fe-69886b21abf2 req-5f89112b-15f9-4b46-85d3-90cad20b44f8 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:25 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Took 0.97 seconds to deallocate network for instance.
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-9ac1764a-40c4-4698-87fe-69886b21abf2 req-5f89112b-15f9-4b46-85d3-90cad20b44f8 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Detach interface failed, port_id=d6633dff-0d5e-416d-a53e-46659b9dbcce, reason: Instance 201a7ef6-4cc0-4e56-8559-52d524bafe16 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:25 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:26 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Deleted allocations for instance 201a7ef6-4cc0-4e56-8559-52d524bafe16
Jul 27 12:52:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ce3982b1-4b60-49fb-a26d-302ec16b2112 tempest-AttachVolumeShelveTestJSON-1527010192 tempest-AttachVolumeShelveTestJSON-1527010192-project-member] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.255s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] Acquiring lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] Lock "201a7ef6-4cc0-4e56-8559-52d524bafe16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] No waiting events found dispatching network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:26 user nova-compute[70994]: WARNING nova.compute.manager [req-9120af90-e8b5-4b62-b476-bbb2fb307563 req-c818010e-21d4-44df-8d33-df66ee20a755 service nova] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Received unexpected event network-vif-plugged-d6633dff-0d5e-416d-a53e-46659b9dbcce for instance with vm_state deleted and task_state None.
Jul 27 12:52:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:28 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:52:28 user nova-compute[70994]: INFO nova.compute.claims [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Claim successful on node user
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:52:29 user nova-compute[70994]: INFO nova.compute.claims [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Claim successful on node user
Jul 27 12:52:29 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.policy [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '593a7d28021a47b491c7fa86af3edc80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cd4ff8af2445179cc6ba07c251dd4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:52:29 user nova-compute[70994]: INFO nova.virt.block_device [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Booting with volume-backed-image 52d4c2ab-cf6e-46c3-b167-9a89ce78020a at /dev/vda
Jul 27 12:52:29 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:52:29 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:52:29 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Successfully created port: 917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.policy [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db8e13665d53464d9e601434a0cbce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4488876cea8e410c9822a55b04cffc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:52:30 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Creating image(s)
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "/opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "/opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk 1073741824" returned: 0 in 0.053s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Cannot resize image /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.objects.instance [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'migration_context' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Ensure instance console log exists: /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Successfully updated port: 917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:30 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-changed-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Refreshing instance network info cache due to event network-changed-917035e3-4e6b-4783-905f-db9070bc02cf. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] Acquiring lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Successfully created port: 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.network.neutron [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating instance_info_cache with network_info: [{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance network_info: |[{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] Acquired lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:31 user nova-compute[70994]: DEBUG nova.network.neutron [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Refreshing network info cache for port 917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Successfully updated port: 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquired lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-changed-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Refreshing instance network info cache due to event network-changed-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] Acquiring lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updated VIF entry in instance network info cache for port 917035e3-4e6b-4783-905f-db9070bc02cf. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating instance_info_cache with network_info: [{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f48a0152-ed64-4d05-a27e-6c774c6d69db req-06f3dda6-23f4-48cf-a941-afd6353e6408 service nova] Releasing lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updating instance_info_cache with network_info: [{"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Releasing lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Instance network_info: |[{"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] Acquired lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Refreshing network info cache for port 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Start _get_guest_xml network_info=[{"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:52:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:32 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:52:32 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-37347075',display_name='tempest-VolumesSnapshotTestJSON-instance-37347075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-37347075',id=31,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHYylf4wHmLOTo7UnLI0ck5aWCK47Bb9KBKjDAhE6OPAkFGCyoVFVU1b9+8XOUtQpwC+5RdlGTSqMcqawrbc4R3u+mInTwNoI11/uPSVukPBKj9gtBj9zbsudri2poaw==',key_name='tempest-keypair-42927591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-yx87goiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=3c59a3aa-d360-4783-89a3-000edfce0e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.objects.instance [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:52:33 user nova-compute[70994]:   <uuid>3c59a3aa-d360-4783-89a3-000edfce0e52</uuid>
Jul 27 12:52:33 user nova-compute[70994]:   <name>instance-0000001f</name>
Jul 27 12:52:33 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:52:33 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:52:33 user nova-compute[70994]:   <metadata>
Jul 27 12:52:33 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:52:33 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-37347075</nova:name>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:52:32</nova:creationTime>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:52:33 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:52:33 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:owner>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:user uuid="db8e13665d53464d9e601434a0cbce1d">tempest-VolumesSnapshotTestJSON-472536409-project-member</nova:user>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:project uuid="4488876cea8e410c9822a55b04cffc8c">tempest-VolumesSnapshotTestJSON-472536409</nova:project>
Jul 27 12:52:33 user nova-compute[70994]:       </nova:owner>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:52:33 user nova-compute[70994]:       <nova:ports>
Jul 27 12:52:33 user nova-compute[70994]:         <nova:port uuid="0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a">
Jul 27 12:52:33 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 12:52:33 user nova-compute[70994]:         </nova:port>
Jul 27 12:52:33 user nova-compute[70994]:       </nova:ports>
Jul 27 12:52:33 user nova-compute[70994]:     </nova:instance>
Jul 27 12:52:33 user nova-compute[70994]:   </metadata>
Jul 27 12:52:33 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:52:33 user nova-compute[70994]:     <system>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="serial">3c59a3aa-d360-4783-89a3-000edfce0e52</entry>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="uuid">3c59a3aa-d360-4783-89a3-000edfce0e52</entry>
Jul 27 12:52:33 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:52:33 user nova-compute[70994]:     </system>
Jul 27 12:52:33 user nova-compute[70994]:   </sysinfo>
Jul 27 12:52:33 user nova-compute[70994]:   <os>
Jul 27 12:52:33 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:52:33 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:52:33 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:52:33 user nova-compute[70994]:   </os>
Jul 27 12:52:33 user nova-compute[70994]:   <features>
Jul 27 12:52:33 user nova-compute[70994]:     <acpi/>
Jul 27 12:52:33 user nova-compute[70994]:     <apic/>
Jul 27 12:52:33 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:52:33 user nova-compute[70994]:   </features>
Jul 27 12:52:33 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:52:33 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:52:33 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:52:33 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:52:33 user nova-compute[70994]:   </clock>
Jul 27 12:52:33 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:52:33 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:52:33 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:52:33 user nova-compute[70994]:   </cpu>
Jul 27 12:52:33 user nova-compute[70994]:   <devices>
Jul 27 12:52:33 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:52:33 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:52:33 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk"/>
Jul 27 12:52:33 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:52:33 user nova-compute[70994]:     </disk>
Jul 27 12:52:33 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:52:33 user nova-compute[70994]:       <mac address="fa:16:3e:aa:0d:62"/>
Jul 27 12:52:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:33 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:52:33 user nova-compute[70994]:       <target dev="tap0fb80b2b-a9"/>
Jul 27 12:52:33 user nova-compute[70994]:     </interface>
Jul 27 12:52:33 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:52:33 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/console.log" append="off"/>
Jul 27 12:52:33 user nova-compute[70994]:     </serial>
Jul 27 12:52:33 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:52:33 user nova-compute[70994]:     <video>
Jul 27 12:52:33 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:33 user nova-compute[70994]:     </video>
Jul 27 12:52:33 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:52:33 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:52:33 user nova-compute[70994]:     </rng>
Jul 27 12:52:33 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:52:33 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:52:33 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:52:33 user nova-compute[70994]:     </memballoon>
Jul 27 12:52:33 user nova-compute[70994]:   </devices>
Jul 27 12:52:33 user nova-compute[70994]: </domain>
Jul 27 12:52:33 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-37347075',display_name='tempest-VolumesSnapshotTestJSON-instance-37347075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-37347075',id=31,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHYylf4wHmLOTo7UnLI0ck5aWCK47Bb9KBKjDAhE6OPAkFGCyoVFVU1b9+8XOUtQpwC+5RdlGTSqMcqawrbc4R3u+mInTwNoI11/uPSVukPBKj9gtBj9zbsudri2poaw==',key_name='tempest-keypair-42927591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-yx87goiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=3c59a3aa-d360-4783-89a3-000edfce0e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG os_vif [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fb80b2b-a9, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fb80b2b-a9, col_values=(('external_ids', {'iface-id': '0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:0d:62', 'vm-uuid': '3c59a3aa-d360-4783-89a3-000edfce0e52'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:33 user nova-compute[70994]: INFO os_vif [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9')
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No VIF found with MAC fa:16:3e:aa:0d:62, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.neutron [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updated VIF entry in instance network info cache for port 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG nova.network.neutron [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updating instance_info_cache with network_info: [{"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-83903b07-9aea-4962-8b7c-eec42c98fcff req-35562b6e-ad4f-4356-bb73-4040f11e43de service nova] Releasing lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:34 user nova-compute[70994]: DEBUG nova.compute.manager [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] No waiting events found dispatching network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:34 user nova-compute[70994]: WARNING nova.compute.manager [req-b83e7324-8df0-499d-81c0-aa6cb569e2fc req-4be20e17-2f7d-49d7-aa30-0a2bf30d31b7 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received unexpected event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a for instance with vm_state building and task_state spawning.
Jul 27 12:52:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.utils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec27636-ed97-4abf-998a-5082bb29565a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b737e8-b628-4bdf-9850-6f836acd69a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9eb8a5-d254-4c99-a5de-c35534c99bfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7922ff1-8e02-4a46-b11d-52ad21615ff3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:52:35 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:52:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d018ed9-e88a-4eaf-a023-afafd57ef806]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG os_brick.utils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:52:35 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating existing volume attachment record: 2314bad9-26d0-4c95-b070-d1f7743bd631 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462356.5891595, 3c59a3aa-d360-4783-89a3-000edfce0e52 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] VM Resumed (Lifecycle Event)
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Instance spawned successfully.
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462356.5909953, 3c59a3aa-d360-4783-89a3-000edfce0e52 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] VM Started (Lifecycle Event)
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] No waiting events found dispatching network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:36 user nova-compute[70994]: WARNING nova.compute.manager [req-f9341916-ffd0-43dc-b184-aa2e89bc302e req-ef2a24a6-2dfc-4fa4-a898-51d806329d80 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received unexpected event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a for instance with vm_state building and task_state spawning.
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Took 6.68 seconds to spawn the instance on the hypervisor.
Jul 27 12:52:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:36 user nova-compute[70994]: INFO nova.compute.manager [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Took 7.57 seconds to build instance.
Jul 27 12:52:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2d7727ee-54bb-4cf5-a067-23e16211ad52 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.700s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:38 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:39 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462344.5097268, 201a7ef6-4cc0-4e56-8559-52d524bafe16 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:39 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] VM Stopped (Lifecycle Event)
Jul 27 12:52:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-73ba95b9-dc7a-45ad-ae71-a52003240fce None None] [instance: 201a7ef6-4cc0-4e56-8559-52d524bafe16] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:52:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Creating image(s)
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Did not create local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Ensure instance console log exists: /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start _get_guest_xml network_info=[{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63c995b0-7c07-4651-9aff-de708915f027', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4e1e910-1997-43d0-a27d-166b0da33dde', 'serial': 'c4e1e910-1997-43d0-a27d-166b0da33dde'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2314bad9-26d0-4c95-b070-d1f7743bd631', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:52:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:52:43 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:52:43 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:52:43 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8b7d9-d431-4afe-bff5-a38b72b3f9c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:52:43 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939ec7e-dd8e-43a0-809b-1824dd9fefc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde] added
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb73fa4-48e7-4444-acd6-eceb74259d23]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffbd643-1dc8-4e10-aa25-f8d5ec57ed70]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFXothwG {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFXothwG" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[005685e7-4c5e-4fe1-9b30-7832e27c2e59]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFXothwG'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c6e57-465e-4ca3-a10d-757d3ff42545]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8dd05d-6a68-4be2-bade-5edbae66fbd6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3893e5-cf07-4fec-8aca-9a30e25733d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260]
Jul 27 12:52:43 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260] successful.
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf885a5e-33ea-4537-860b-8ee6d7b83a00]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba26ddb6-29f7-4d70-8cf3-26eeca83ee3a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:52:43 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:52:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1960e-9130-4121-b6aa-5bff3a4954e6]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:52:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7278MB free_disk=25.20083999633789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23037646537336536', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037646537336536', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 458795b5-f71d-4459-869a-e59a967bba09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3c59a3aa-d360-4783-89a3-000edfce0e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:52:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1001634945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1001634945',id=30,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-hoop5re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:30Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=63c995b0-7c07-4651-9aff-de708915f027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:52:45 user nova-compute[70994]:   <uuid>63c995b0-7c07-4651-9aff-de708915f027</uuid>
Jul 27 12:52:45 user nova-compute[70994]:   <name>instance-0000001e</name>
Jul 27 12:52:45 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:52:45 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:52:45 user nova-compute[70994]:   <metadata>
Jul 27 12:52:45 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:52:45 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1001634945</nova:name>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:52:43</nova:creationTime>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:52:45 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:52:45 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:owner>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:52:45 user nova-compute[70994]:       </nova:owner>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:52:45 user nova-compute[70994]:       <nova:ports>
Jul 27 12:52:45 user nova-compute[70994]:         <nova:port uuid="917035e3-4e6b-4783-905f-db9070bc02cf">
Jul 27 12:52:45 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:52:45 user nova-compute[70994]:         </nova:port>
Jul 27 12:52:45 user nova-compute[70994]:       </nova:ports>
Jul 27 12:52:45 user nova-compute[70994]:     </nova:instance>
Jul 27 12:52:45 user nova-compute[70994]:   </metadata>
Jul 27 12:52:45 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:52:45 user nova-compute[70994]:     <system>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="serial">63c995b0-7c07-4651-9aff-de708915f027</entry>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="uuid">63c995b0-7c07-4651-9aff-de708915f027</entry>
Jul 27 12:52:45 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:52:45 user nova-compute[70994]:     </system>
Jul 27 12:52:45 user nova-compute[70994]:   </sysinfo>
Jul 27 12:52:45 user nova-compute[70994]:   <os>
Jul 27 12:52:45 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:52:45 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:52:45 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:52:45 user nova-compute[70994]:   </os>
Jul 27 12:52:45 user nova-compute[70994]:   <features>
Jul 27 12:52:45 user nova-compute[70994]:     <acpi/>
Jul 27 12:52:45 user nova-compute[70994]:     <apic/>
Jul 27 12:52:45 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:52:45 user nova-compute[70994]:   </features>
Jul 27 12:52:45 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:52:45 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:52:45 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:52:45 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:52:45 user nova-compute[70994]:   </clock>
Jul 27 12:52:45 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:52:45 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:52:45 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:52:45 user nova-compute[70994]:   </cpu>
Jul 27 12:52:45 user nova-compute[70994]:   <devices>
Jul 27 12:52:45 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:52:45 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:52:45 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:52:45 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:52:45 user nova-compute[70994]:       <serial>c4e1e910-1997-43d0-a27d-166b0da33dde</serial>
Jul 27 12:52:45 user nova-compute[70994]:     </disk>
Jul 27 12:52:45 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:52:45 user nova-compute[70994]:       <mac address="fa:16:3e:00:04:a3"/>
Jul 27 12:52:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:45 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:52:45 user nova-compute[70994]:       <target dev="tap917035e3-4e"/>
Jul 27 12:52:45 user nova-compute[70994]:     </interface>
Jul 27 12:52:45 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:52:45 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/console.log" append="off"/>
Jul 27 12:52:45 user nova-compute[70994]:     </serial>
Jul 27 12:52:45 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:52:45 user nova-compute[70994]:     <video>
Jul 27 12:52:45 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:45 user nova-compute[70994]:     </video>
Jul 27 12:52:45 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:52:45 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:52:45 user nova-compute[70994]:     </rng>
Jul 27 12:52:45 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:52:45 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:52:45 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:52:45 user nova-compute[70994]:     </memballoon>
Jul 27 12:52:45 user nova-compute[70994]:   </devices>
Jul 27 12:52:45 user nova-compute[70994]: </domain>
Jul 27 12:52:45 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1001634945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1001634945',id=30,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-hoop5re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:30Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=63c995b0-7c07-4651-9aff-de708915f027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG os_vif [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap917035e3-4e, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap917035e3-4e, col_values=(('external_ids', {'iface-id': '917035e3-4e6b-4783-905f-db9070bc02cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:04:a3', 'vm-uuid': '63c995b0-7c07-4651-9aff-de708915f027'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:45 user nova-compute[70994]: INFO os_vif [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e')
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:00:04:a3, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:52:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:46 user nova-compute[70994]: WARNING nova.compute.manager [req-58b26b30-fe10-4bdb-a075-eb51ce9ee6c4 req-98c10dd6-0ccc-4ed3-9b48-03bead05b6d3 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state building and task_state spawning.
Jul 27 12:52:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462368.541284, 63c995b0-7c07-4651-9aff-de708915f027 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Resumed (Lifecycle Event)
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance spawned successfully.
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462368.5417929, 63c995b0-7c07-4651-9aff-de708915f027 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Started (Lifecycle Event)
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Took 5.22 seconds to spawn the instance on the hypervisor.
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:48 user nova-compute[70994]: WARNING nova.compute.manager [req-39b7764e-38c0-43f4-a859-1090bca4209e req-522dfcb5-b998-46e9-aea9-b32934ef4468 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state building and task_state spawning.
Jul 27 12:52:48 user nova-compute[70994]: INFO nova.compute.manager [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Took 19.98 seconds to build instance.
Jul 27 12:52:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6c61cfc9-b72b-4ca7-954f-e1bf0a364cc3 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.082s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:52:54 user nova-compute[70994]: INFO nova.compute.claims [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Claim successful on node user
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:52:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:52:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG nova.policy [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81685771daeb49bfbe069cb849e82adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92730f3b460c4f5c816d4aaad7645039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:52:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Creating image(s)
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.part --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG nova.virt.images [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] 93186396-f12e-4e28-a24d-9de7b7d114f0 was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:52:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.part /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Successfully created port: 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.part /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.converted" returned: 0 in 0.309s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.231s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json" returned: 0 in 0.177s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985,backing_fmt=raw /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985,backing_fmt=raw /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk 1073741824" returned: 0 in 0.103s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "e3a2ad7792eda922cd5570b98c2d9eff31f57985" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Successfully updated port: 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing instance network info cache due to event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Cannot resize image /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'migration_context' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Ensure instance console log exists: /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.neutron [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance network_info: |[{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.neutron [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start _get_guest_xml network_info=[{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:52:51Z,direct_url=<?>,disk_format='qcow2',id=93186396-f12e-4e28-a24d-9de7b7d114f0,min_disk=0,min_ram=0,name='tempest-scenario-img--536721139',owner='92730f3b460c4f5c816d4aaad7645039',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:52:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '93186396-f12e-4e28-a24d-9de7b7d114f0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:52:57 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:57 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:52:51Z,direct_url=<?>,disk_format='qcow2',id=93186396-f12e-4e28-a24d-9de7b7d114f0,min_disk=0,min_ram=0,name='tempest-scenario-img--536721139',owner='92730f3b460c4f5c816d4aaad7645039',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:52:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:55Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:52:57 user nova-compute[70994]:   <uuid>3ae811b1-0975-42e0-82ab-be09c2c2ec11</uuid>
Jul 27 12:52:57 user nova-compute[70994]:   <name>instance-00000020</name>
Jul 27 12:52:57 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:52:57 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:52:57 user nova-compute[70994]:   <metadata>
Jul 27 12:52:57 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:52:57 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:name>tempest-TestMinimumBasicScenario-server-519794403</nova:name>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:52:57</nova:creationTime>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:52:57 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:52:57 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:owner>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:user uuid="81685771daeb49bfbe069cb849e82adf">tempest-TestMinimumBasicScenario-312128031-project-member</nova:user>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:project uuid="92730f3b460c4f5c816d4aaad7645039">tempest-TestMinimumBasicScenario-312128031</nova:project>
Jul 27 12:52:57 user nova-compute[70994]:       </nova:owner>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:root type="image" uuid="93186396-f12e-4e28-a24d-9de7b7d114f0"/>
Jul 27 12:52:57 user nova-compute[70994]:       <nova:ports>
Jul 27 12:52:57 user nova-compute[70994]:         <nova:port uuid="8631dbc1-a0ad-4dc2-9734-094dc6fb5139">
Jul 27 12:52:57 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 12:52:57 user nova-compute[70994]:         </nova:port>
Jul 27 12:52:57 user nova-compute[70994]:       </nova:ports>
Jul 27 12:52:57 user nova-compute[70994]:     </nova:instance>
Jul 27 12:52:57 user nova-compute[70994]:   </metadata>
Jul 27 12:52:57 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:52:57 user nova-compute[70994]:     <system>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="serial">3ae811b1-0975-42e0-82ab-be09c2c2ec11</entry>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="uuid">3ae811b1-0975-42e0-82ab-be09c2c2ec11</entry>
Jul 27 12:52:57 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:52:57 user nova-compute[70994]:     </system>
Jul 27 12:52:57 user nova-compute[70994]:   </sysinfo>
Jul 27 12:52:57 user nova-compute[70994]:   <os>
Jul 27 12:52:57 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:52:57 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:52:57 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:52:57 user nova-compute[70994]:   </os>
Jul 27 12:52:57 user nova-compute[70994]:   <features>
Jul 27 12:52:57 user nova-compute[70994]:     <acpi/>
Jul 27 12:52:57 user nova-compute[70994]:     <apic/>
Jul 27 12:52:57 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:52:57 user nova-compute[70994]:   </features>
Jul 27 12:52:57 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:52:57 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:52:57 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:52:57 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:52:57 user nova-compute[70994]:   </clock>
Jul 27 12:52:57 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:52:57 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:52:57 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:52:57 user nova-compute[70994]:   </cpu>
Jul 27 12:52:57 user nova-compute[70994]:   <devices>
Jul 27 12:52:57 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:52:57 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:52:57 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk"/>
Jul 27 12:52:57 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:52:57 user nova-compute[70994]:     </disk>
Jul 27 12:52:57 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:52:57 user nova-compute[70994]:       <mac address="fa:16:3e:85:2e:6b"/>
Jul 27 12:52:57 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:57 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:52:57 user nova-compute[70994]:       <target dev="tap8631dbc1-a0"/>
Jul 27 12:52:57 user nova-compute[70994]:     </interface>
Jul 27 12:52:57 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:52:57 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/console.log" append="off"/>
Jul 27 12:52:57 user nova-compute[70994]:     </serial>
Jul 27 12:52:57 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:52:57 user nova-compute[70994]:     <video>
Jul 27 12:52:57 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:52:57 user nova-compute[70994]:     </video>
Jul 27 12:52:57 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:52:57 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:52:57 user nova-compute[70994]:     </rng>
Jul 27 12:52:57 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:52:57 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:52:57 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:52:57 user nova-compute[70994]:     </memballoon>
Jul 27 12:52:57 user nova-compute[70994]:   </devices>
Jul 27 12:52:57 user nova-compute[70994]: </domain>
Jul 27 12:52:57 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:55Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG os_vif [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8631dbc1-a0, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8631dbc1-a0, col_values=(('external_ids', {'iface-id': '8631dbc1-a0ad-4dc2-9734-094dc6fb5139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:2e:6b', 'vm-uuid': '3ae811b1-0975-42e0-82ab-be09c2c2ec11'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:57 user nova-compute[70994]: INFO os_vif [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0')
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No VIF found with MAC fa:16:3e:85:2e:6b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:52:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:58 user nova-compute[70994]: DEBUG nova.network.neutron [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updated VIF entry in instance network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:52:58 user nova-compute[70994]: DEBUG nova.network.neutron [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:52:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bb8d1868-d1fd-40c7-bf67-9652a14335d4 req-ad9dc0d2-3998-4dee-b112-e1e643aa0c38 service nova] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG nova.compute.manager [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:52:59 user nova-compute[70994]: WARNING nova.compute.manager [req-362eb968-fae2-4ed6-8783-a512c97ddb12 req-1fcb09b5-9a98-4c7e-b4f8-da3e57144e3d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state building and task_state spawning.
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:52:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Unrescuing
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.network.neutron [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462381.5585835, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] VM Resumed (Lifecycle Event)
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance spawned successfully.
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462381.5686016, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] VM Started (Lifecycle Event)
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:01 user nova-compute[70994]: WARNING nova.compute.manager [req-fe4675ca-2315-4657-9c6d-0a6ee0b52d9f req-81cfdcb4-dae2-4c0f-b446-0beb6690187d service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state building and task_state spawning.
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Took 6.65 seconds to spawn the instance on the hypervisor.
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.network.neutron [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:01 user nova-compute[70994]: DEBUG nova.objects.instance [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'flavor' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:53:01 user nova-compute[70994]: INFO nova.compute.manager [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Took 7.75 seconds to build instance.
Jul 27 12:53:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-468d9199-e6ff-4892-8896-9b8284d4927f tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.854s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing instance network info cache due to event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:02 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance destroyed successfully.
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updated VIF entry in instance network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.network.neutron [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5e31d03d-a5c3-47f8-b47a-d11c1c5e38e4 req-1e5188a3-5238-4c8e-929d-afa343acd484 service nova] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:03 user nova-compute[70994]: WARNING nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:03 user nova-compute[70994]: WARNING nova.compute.manager [req-65684652-f19e-4f20-89e0-61fa40e325f5 req-7c372704-8993-4c47-b5b5-94e2dd9d2c5c service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:53:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing instance network info cache due to event network-changed-33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Refreshing network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.network.neutron [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updated VIF entry in instance network info cache for port 33013b4d-599e-46b0-9f2d-446217b3e442. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.network.neutron [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9c0d874c-9ac3-462f-b98b-cb3fe6363a6f req-7daf9e39-6902-4f69-8e89-1638ea05fb1f service nova] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:05 user nova-compute[70994]: WARNING nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:05 user nova-compute[70994]: DEBUG nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:05 user nova-compute[70994]: WARNING nova.compute.manager [req-c019b0a6-891e-4cb8-a5bf-7f126b3fce57 req-f7e8a5d2-8d98-4826-b9c9-43bd74fad012 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for f9432eac-732b-4dcc-b8af-abb390b7cb55 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462387.4717252, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:53:07 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Resumed (Lifecycle Event)
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-57629446-a9ee-4e79-9410-2c3518404236 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:53:07 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462387.4814248, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:53:07 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Started (Lifecycle Event)
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:07 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:53:07 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 12:53:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-changed-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Refreshing instance network info cache due to event network-changed-f9767de3-e268-41c7-ab74-7a7e7de32ea6. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:53:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] Acquiring lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] Acquired lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Refreshing network info cache for port f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:12 user nova-compute[70994]: INFO nova.compute.manager [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Terminating instance
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.compute.manager [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Instance destroyed successfully.
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'resources' on Instance uuid 458795b5-f71d-4459-869a-e59a967bba09 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262119528',display_name='tempest-AttachVolumeNegativeTest-server-262119528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262119528',id=29,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6Kf5hYCRxaCY3Zj3ExbSaBfgG4Tk1BgGcNFGGi2FDgDN+iPLznWQa4anhsjVwbskaFK8HcH9b0NAImB27kkmL9s5AdDmkbk/3od1M0553PMhg7udt7+ilAEoTdTgGYsQ==',key_name='tempest-keypair-706608618',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-hwwj1h94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=458795b5-f71d-4459-869a-e59a967bba09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG os_vif [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9767de3-e2, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:53:12 user nova-compute[70994]: INFO os_vif [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:8f:a8,bridge_name='br-int',has_traffic_filtering=True,id=f9767de3-e268-41c7-ab74-7a7e7de32ea6,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9767de3-e2')
Jul 27 12:53:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Deleting instance files /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09_del
Jul 27 12:53:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Deletion of /opt/stack/data/nova/instances/458795b5-f71d-4459-869a-e59a967bba09_del complete
Jul 27 12:53:12 user nova-compute[70994]: INFO nova.compute.manager [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Took 0.69 seconds to destroy the instance on the hypervisor.
Jul 27 12:53:12 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:53:12 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updated VIF entry in instance network info cache for port f9767de3-e268-41c7-ab74-7a7e7de32ea6. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.network.neutron [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updating instance_info_cache with network_info: [{"id": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "address": "fa:16:3e:da:8f:a8", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9767de3-e2", "ovs_interfaceid": "f9767de3-e268-41c7-ab74-7a7e7de32ea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4f962c9b-c911-425d-a608-ce4ca7dd78cf req-b0eb8650-8d46-4e00-b1ad-291bf3b46cc2 service nova] Releasing lock "refresh_cache-458795b5-f71d-4459-869a-e59a967bba09" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-unplugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] No waiting events found dispatching network-vif-unplugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-unplugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Acquiring lock "458795b5-f71d-4459-869a-e59a967bba09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] Lock "458795b5-f71d-4459-869a-e59a967bba09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] No waiting events found dispatching network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:53:13 user nova-compute[70994]: WARNING nova.compute.manager [req-7ed6042d-8a57-4f75-a4d1-7dda674a684a req-356ead0a-8ce4-4f57-9a29-6dcc8c99a8bd service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received unexpected event network-vif-plugged-f9767de3-e268-41c7-ab74-7a7e7de32ea6 for instance with vm_state active and task_state deleting.
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:13 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Took 1.14 seconds to deallocate network for instance.
Jul 27 12:53:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-11f704f0-a19e-4298-964a-ae63c50bee05 req-6c002f98-0d44-4f08-aaf7-88fab2272817 service nova] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Received event network-vif-deleted-f9767de3-e268-41c7-ab74-7a7e7de32ea6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:14 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:53:14 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:53:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:14 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Deleted allocations for instance 458795b5-f71d-4459-869a-e59a967bba09
Jul 27 12:53:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-c4da6424-638f-435b-9869-ab3658fcc207 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "458795b5-f71d-4459-869a-e59a967bba09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:27 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462392.6527145, 458795b5-f71d-4459-869a-e59a967bba09 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:53:27 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 458795b5-f71d-4459-869a-e59a967bba09] VM Stopped (Lifecycle Event)
Jul 27 12:53:27 user nova-compute[70994]: DEBUG nova.compute.manager [None req-81768cf1-99a2-4625-87f0-0219e9b28d5e None None] [instance: 458795b5-f71d-4459-869a-e59a967bba09] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:53:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing instance network info cache due to event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:53:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:29 user nova-compute[70994]: DEBUG nova.network.neutron [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:30 user nova-compute[70994]: INFO nova.compute.manager [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Detaching volume 1dac2c13-d244-462e-a680-a1bb61647c30
Jul 27 12:53:30 user nova-compute[70994]: INFO nova.virt.block_device [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Attempting to driver detach volume 1dac2c13-d244-462e-a680-a1bb61647c30 from mountpoint /dev/vdb
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Attempting to detach device vdb from instance b5a77277-e67a-4d4f-9203-36ec4040f373 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:53:30 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:53:30 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:53:30 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:53:30 user nova-compute[70994]:   <serial>1dac2c13-d244-462e-a680-a1bb61647c30</serial>
Jul 27 12:53:30 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:53:30 user nova-compute[70994]: </disk>
Jul 27 12:53:30 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:53:30 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully detached device vdb from instance b5a77277-e67a-4d4f-9203-36ec4040f373 from the persistent domain config.
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5a77277-e67a-4d4f-9203-36ec4040f373 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:53:30 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:53:30 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:53:30 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:53:30 user nova-compute[70994]:   <serial>1dac2c13-d244-462e-a680-a1bb61647c30</serial>
Jul 27 12:53:30 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:53:30 user nova-compute[70994]: </disk>
Jul 27 12:53:30 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.network.neutron [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updated VIF entry in instance network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG nova.network.neutron [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7f893bbe-77ca-4afa-b448-28fc7e6ae14c req-d1c05f51-433a-474c-91e3-33807c0d6766 service nova] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462411.1095104, b5a77277-e67a-4d4f-9203-36ec4040f373 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:53:31 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully detached device vdb from instance b5a77277-e67a-4d4f-9203-36ec4040f373 from the live domain config.
Jul 27 12:53:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryptUPkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:53:31 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da305f67-82fa-45a1-b41d-3efc1b29d72c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:53:31 user nova-compute[70994]: No targets found.
Jul 27 12:53:31 user nova-compute[70994]: iSNS:
Jul 27 12:53:31 user nova-compute[70994]: No targets found.
Jul 27 12:53:31 user nova-compute[70994]: STATIC:
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:53:31 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:31 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:31 user nova-compute[70994]: FIRMWARE:
Jul 27 12:53:31 user nova-compute[70994]: No targets found.
Jul 27 12:53:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:53:31 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:53:31 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c1605-0b62-4d53-95e7-11a570aefbe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641d4a4-0a53-4004-9bfe-5208df965ede]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:53:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:53:31 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:53:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc759750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2e8128-5ed9-4cdf-9cfa-06f9d1795db6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be57a9-9b9b-4b85-92ff-bd1899d71f9f]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f7ab19-b3c8-492a-8c86-83d20a1dad7e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15225c2-69f7-4a88-9992-5879fbcf50df]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[678d0976-a232-4fe3-ae57-7edd9ab2ff61]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef6eac-44e5-4ca0-9d93-cc3594960191]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260]
Jul 27 12:53:31 user nova-compute[70994]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30, portal: 172.16.0.220,3260] successful.
Jul 27 12:53:31 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dac2c13-d244-462e-a680-a1bb61647c30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c56782-24d2-47e5-9240-c5a6d4b8a54a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] <== disconnect_volume: return (342ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:53:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.compute.manager [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing instance network info cache due to event network-changed-015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] Acquiring lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] Acquired lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Refreshing network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.objects.instance [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'flavor' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-be324aaf-d98c-4164-af28-7a983051ecb0 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.816s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updated VIF entry in instance network info cache for port 015b578b-c90a-40da-a6c8-ef45c11642fe. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG nova.network.neutron [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [{"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fc46948f-6dae-4f6d-b80f-621f0c6ff5ba req-dd08ec8f-c89f-44a5-b991-e3cc6f2e6579 service nova] Releasing lock "refresh_cache-b5a77277-e67a-4d4f-9203-36ec4040f373" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [{"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-f9432eac-732b-4dcc-b8af-abb390b7cb55" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:53:33 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:53:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:34 user nova-compute[70994]: INFO nova.compute.manager [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Detaching volume 694c3ac5-e145-443e-85c6-643ee1b3bc2b
Jul 27 12:53:34 user nova-compute[70994]: INFO nova.virt.block_device [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Attempting to driver detach volume 694c3ac5-e145-443e-85c6-643ee1b3bc2b from mountpoint /dev/vdb
Jul 27 12:53:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Attempting to detach device vdb from instance f9432eac-732b-4dcc-b8af-abb390b7cb55 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:53:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:53:34 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:53:34 user nova-compute[70994]:   <source dev="/dev/sdg"/>
Jul 27 12:53:34 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:53:34 user nova-compute[70994]:   <serial>694c3ac5-e145-443e-85c6-643ee1b3bc2b</serial>
Jul 27 12:53:34 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:53:34 user nova-compute[70994]: </disk>
Jul 27 12:53:34 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:53:34 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Successfully detached device vdb from instance f9432eac-732b-4dcc-b8af-abb390b7cb55 from the persistent domain config.
Jul 27 12:53:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9432eac-732b-4dcc-b8af-abb390b7cb55 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:53:34 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:53:34 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:53:34 user nova-compute[70994]:   <source dev="/dev/sdg"/>
Jul 27 12:53:34 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:53:34 user nova-compute[70994]:   <serial>694c3ac5-e145-443e-85c6-643ee1b3bc2b</serial>
Jul 27 12:53:34 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:53:34 user nova-compute[70994]: </disk>
Jul 27 12:53:34 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462415.256428, f9432eac-732b-4dcc-b8af-abb390b7cb55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:53:35 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Successfully detached device vdb from instance f9432eac-732b-4dcc-b8af-abb390b7cb55 from the live domain config.
Jul 27 12:53:35 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGKFcoZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:53:35 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a114a2-c31e-4866-9a60-ce8bae21a4de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:53:35 user nova-compute[70994]: No targets found.
Jul 27 12:53:35 user nova-compute[70994]: iSNS:
Jul 27 12:53:35 user nova-compute[70994]: No targets found.
Jul 27 12:53:35 user nova-compute[70994]: STATIC:
Jul 27 12:53:35 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17
Jul 27 12:53:35 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:35 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:35 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:53:35 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:35 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:35 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:53:35 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:35 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:35 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b
Jul 27 12:53:35 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:35 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:35 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:53:35 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:53:35 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:53:35 user nova-compute[70994]: FIRMWARE:
Jul 27 12:53:35 user nova-compute[70994]: No targets found.
Jul 27 12:53:35 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:53:35 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:53:35 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a01192-2c19-48f6-b90b-0976d8e86294]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c240ff6-4ac6-4d6e-872d-7dca7bc01fae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:53:35 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:53:35 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:53:35 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc47f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b'): ({'sdg'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Removing single pathed devices sdg {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9696d618-1482-4fb4-81b9-45553ccc3403]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e96e13-bb24-4e0f-b4bf-0685fe006b14]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Flushing IO for device /dev/sdg {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3c4ed-b4fe-444b-a6cb-b05595ebd1a9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ddecc6-82e2-4685-95b3-504a315c030a]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] SCSI volumes sdg have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[14adefad-8393-448d-932c-182e06ab5e4d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f301afe2-0c5f-4f6b-b4aa-4571b3bc58e4]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260]
Jul 27 12:53:35 user nova-compute[70994]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b, portal: 172.16.0.220,3260] successful.
Jul 27 12:53:35 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694c3ac5-e145-443e-85c6-643ee1b3bc2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[407def53-5334-4a04-9109-121499cefefe]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] <== disconnect_volume: return (335ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:53:35 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:53:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'flavor' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:53:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b92d372e-0e2c-4fb6-80b5-b5536ca7667f tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.835s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:53:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:53:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:53:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7004MB free_disk=25.098739624023438GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9432eac-732b-4dcc-b8af-abb390b7cb55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance b5a77277-e67a-4d4f-9203-36ec4040f373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3c59a3aa-d360-4783-89a3-000edfce0e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 12:53:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:53:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:53:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 12:53:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] There are 0 instances to clean {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 12:53:49 user nova-compute[70994]: INFO nova.compute.manager [None req-ef4c586b-f53b-4456-a9ae-b3ef5c00e2ba tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Get console output
Jul 27 12:53:49 user nova-compute[70994]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 27 12:53:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:53:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:04 user nova-compute[70994]: INFO nova.compute.manager [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Detaching volume 6c05e73f-93f5-4504-836d-1f6ea8923a17
Jul 27 12:54:04 user nova-compute[70994]: INFO nova.virt.block_device [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Attempting to driver detach volume 6c05e73f-93f5-4504-836d-1f6ea8923a17 from mountpoint /dev/vdb
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Attempting to detach device vdb from instance e24b9029-64dc-4b6b-ad8d-94f021bee52e from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:54:04 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:54:04 user nova-compute[70994]:   <source dev="/dev/sdh"/>
Jul 27 12:54:04 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:54:04 user nova-compute[70994]:   <serial>6c05e73f-93f5-4504-836d-1f6ea8923a17</serial>
Jul 27 12:54:04 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:54:04 user nova-compute[70994]: </disk>
Jul 27 12:54:04 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:54:04 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully detached device vdb from instance e24b9029-64dc-4b6b-ad8d-94f021bee52e from the persistent domain config.
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e24b9029-64dc-4b6b-ad8d-94f021bee52e from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:54:04 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:54:04 user nova-compute[70994]:   <source dev="/dev/sdh"/>
Jul 27 12:54:04 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:54:04 user nova-compute[70994]:   <serial>6c05e73f-93f5-4504-836d-1f6ea8923a17</serial>
Jul 27 12:54:04 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:54:04 user nova-compute[70994]: </disk>
Jul 27 12:54:04 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462444.9342937, e24b9029-64dc-4b6b-ad8d-94f021bee52e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:54:04 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully detached device vdb from instance e24b9029-64dc-4b6b-ad8d-94f021bee52e from the live domain config.
Jul 27 12:54:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsMQqhJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:04 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2a776-a23a-4eac-a0cd-1ac98ba06742]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:54:04 user nova-compute[70994]: No targets found.
Jul 27 12:54:04 user nova-compute[70994]: iSNS:
Jul 27 12:54:04 user nova-compute[70994]: No targets found.
Jul 27 12:54:04 user nova-compute[70994]: STATIC:
Jul 27 12:54:04 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17
Jul 27 12:54:04 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:04 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:04 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:54:04 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:04 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:04 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:54:04 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:04 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:04 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:54:04 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:04 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:04 user nova-compute[70994]: FIRMWARE:
Jul 27 12:54:04 user nova-compute[70994]: No targets found.
Jul 27 12:54:04 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:54:04 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:54:04 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f521536-a73a-4216-8b4d-d61ad0e5c2c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d314659-7e63-4eff-b99a-d4bf1d1127b5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 (non-flash)
Jul 27 12:54:05 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc5ab0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17'): ({'sdh'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Removing single pathed devices sdh {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d196875f-66da-40d2-ac0c-fbbe92d5d803]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c340c91-494a-4f8c-a289-b66ae082ab4d]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flushing IO for device /dev/sdh {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[40679c82-cbff-438d-a1b7-146096eb6ee5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4848ca5-3a9c-47e7-9309-4cb730761271]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] SCSI volumes sdh have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aea60cb-b68b-465a-96e3-95481cc7347f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a54b5-829d-4c89-803c-b5ac756dd783]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260]
Jul 27 12:54:05 user nova-compute[70994]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17, portal: 172.16.0.220,3260] successful.
Jul 27 12:54:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c05e73f-93f5-4504-836d-1f6ea8923a17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f9fb8-ab8b-4492-94ff-3a66c1cf7536]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== disconnect_volume: return (320ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:54:06 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e259308f-600b-4da2-b3d3-7de63f748e81 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:54:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 1233d1bf-9c86-45fb-8ed6-bd15064226d3 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Triggering sync for uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e31094ff-43ca-4256-a933-25ee73995818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "aa5113ca-9965-4138-af35-af69b50f9500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "63c995b0-7c07-4651-9aff-de708915f027" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e31094ff-43ca-4256-a933-25ee73995818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "aa5113ca-9965-4138-af35-af69b50f9500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "63c995b0-7c07-4651-9aff-de708915f027" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:19 user nova-compute[70994]: INFO nova.compute.manager [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Rescuing
Jul 27 12:54:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:54:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:54:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:20 user nova-compute[70994]: INFO nova.compute.manager [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Terminating instance
Jul 27 12:54:20 user nova-compute[70994]: DEBUG nova.compute.manager [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-03781d63-fb9f-498a-93fc-da54b2f47398 req-f0d434d3-7f70-420f-aa9d-491b6481b15d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-unplugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating instance_info_cache with network_info: [{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:54:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Instance destroyed successfully.
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid b5a77277-e67a-4d4f-9203-36ec4040f373 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-changed-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Refreshing instance network info cache due to event network-changed-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] Acquiring lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] Acquired lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.network.neutron [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Refreshing network info cache for port 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355877842',display_name='tempest-ServerRescueNegativeTestJSON-server-1355877842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355877842',id=23,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmKyItTG+LMuGbv/kyalGYAo/fWmbk/9mxmeCeAsGBw7J2CIXXDmsJeZ9cywYg3vPF2UcWjCyv4n1mnRH8+gT2HkPD1TJuUiAIJoZ1/W3OFZmAkg6SDysMhi0sHafYtuQ==',key_name='tempest-keypair-1732909560',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-3el1wn82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=b5a77277-e67a-4d4f-9203-36ec4040f373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "015b578b-c90a-40da-a6c8-ef45c11642fe", "address": "fa:16:3e:dd:6f:36", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap015b578b-c9", "ovs_interfaceid": "015b578b-c90a-40da-a6c8-ef45c11642fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG os_vif [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap015b578b-c9, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: INFO os_vif [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=015b578b-c90a-40da-a6c8-ef45c11642fe,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap015b578b-c9')
Jul 27 12:54:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Deleting instance files /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373_del
Jul 27 12:54:21 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Deletion of /opt/stack/data/nova/instances/b5a77277-e67a-4d4f-9203-36ec4040f373_del complete
Jul 27 12:54:21 user nova-compute[70994]: INFO nova.compute.manager [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Ignoring supplied device name: /dev/vdb
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:22 user nova-compute[70994]: INFO nova.compute.manager [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Attaching volume aed26a91-717e-4f48-a836-e9d3137a9dbe to /dev/vdb
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.utils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.039s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e1f7e-02ed-40b7-9ffe-0a2ed4830dc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[801415b3-2546-4f4f-9003-1f7b40df7c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance destroyed successfully.
Jul 27 12:54:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Attempting a stable device rescue
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de10225-5e63-4cea-af0b-c52f40da176f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe5248-ecb6-4c01-9eaf-dbcbd73f2bbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updated VIF entry in instance network info cache for port 0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updating instance_info_cache with network_info: [{"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:54:22 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5e912-2225-4b39-8e37-e97d10b070c5]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG os_brick.utils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updating existing volume attachment record: 170320f3-9fa2-4748-8297-b819190ed673 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f20f31fa-22a4-489f-969a-15b332d4619f req-39bfb7dc-dcc6-4bdc-a37b-5afd6ce45a48 service nova] Releasing lock "refresh_cache-3c59a3aa-d360-4783-89a3-000edfce0e52" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance directory exists: not creating {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 12:54:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Creating image(s)
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] Acquiring lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] No waiting events found dispatching network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:23 user nova-compute[70994]: WARNING nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received unexpected event network-vif-plugged-015b578b-c90a-40da-a6c8-ef45c11642fe for instance with vm_state active and task_state deleting.
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Received event network-vif-deleted-015b578b-c90a-40da-a6c8-ef45c11642fe {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:23 user nova-compute[70994]: INFO nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Neutron deleted interface 015b578b-c90a-40da-a6c8-ef45c11642fe; detaching it from the instance and deleting it from the info cache
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.network.neutron [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:23 user nova-compute[70994]: WARNING nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state active and task_state rescuing.
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:23 user nova-compute[70994]: WARNING nova.compute.manager [req-f309d838-9abd-4577-a687-7132cd671fd1 req-61481405-f0c4-48bc-a677-e48946b0dc58 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state active and task_state rescuing.
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-1f3efbae-1a09-4255-ac1a-e761f7b9b4d2 req-0b3c5b02-e870-431d-8dd1-d3cb7452a64d service nova] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Detach interface failed, port_id=015b578b-c90a-40da-a6c8-ef45c11642fe, reason: Instance b5a77277-e67a-4d4f-9203-36ec4040f373 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:54:23 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Took 2.14 seconds to deallocate network for instance.
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.part --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG nova.virt.images [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] 2586221c-9512-449d-bb6d-41782dfe9842 was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.part /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.part /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.converted" returned: 0 in 0.681s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.701s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:24 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Deleted allocations for instance b5a77277-e67a-4d4f-9203-36ec4040f373
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.330s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-263a989c-35c2-45e6-9490-f0af370cddf4 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "b5a77277-e67a-4d4f-9203-36ec4040f373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.122s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606 --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606,backing_fmt=raw /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d85f7151296e9d9be61cebf6145ffb4aa657e606,backing_fmt=raw /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue" returned: 0 in 0.058s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "d85f7151296e9d9be61cebf6145ffb4aa657e606" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'migration_context' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start _get_guest_xml network_info=[{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:00:04:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2586221c-9512-449d-bb6d-41782dfe9842', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '63c995b0-7c07-4651-9aff-de708915f027', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4e1e910-1997-43d0-a27d-166b0da33dde', 'serial': 'c4e1e910-1997-43d0-a27d-166b0da33dde'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2314bad9-26d0-4c95-b070-d1f7743bd631', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'numa_topology' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:54:25 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:25 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:25 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:25 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec4dc4b-9d1d-42c8-a636-86cf4c9e678a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qFXothwG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 12:54:25 user nova-compute[70994]: node.name = iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:54:25 user nova-compute[70994]: node.tpgt = -1
Jul 27 12:54:25 user nova-compute[70994]: node.startup = automatic
Jul 27 12:54:25 user nova-compute[70994]: node.leading_login = No
Jul 27 12:54:25 user nova-compute[70994]: iface.iscsi_ifacename = default
Jul 27 12:54:25 user nova-compute[70994]: iface.net_ifacename = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.ipaddress = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.prefix_len = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.hwaddress = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.transport_name = tcp
Jul 27 12:54:25 user nova-compute[70994]: iface.initiatorname = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.vlan_id = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.vlan_priority = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.vlan_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.iface_num = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.mtu = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.port = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.bootproto = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.subnet_mask = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.gateway = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_alt_client_id = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_dns = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_learn_iqn = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_vendor_id_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_vendor_id = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.dhcp_slp_da = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.fragmentation = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.gratuitous_arp = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.incoming_forwarding = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.tos_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.tos = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.ttl = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.delayed_ack = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.tcp_nagle = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.tcp_wsf_state = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.tcp_wsf = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.tcp_timer_scale = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.tcp_timestamp = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.redirect = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.def_task_mgmt_timeout = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.header_digest = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.data_digest = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.immediate_data = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.initial_r2t = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.data_seq_inorder = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.data_pdu_inorder = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.erl = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.max_receive_data_len = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.first_burst_len = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.max_outstanding_r2t = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.max_burst_len = 0
Jul 27 12:54:25 user nova-compute[70994]: iface.chap_auth = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.bidi_chap = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.strict_login_compliance = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.discovery_auth = <empty>
Jul 27 12:54:25 user nova-compute[70994]: iface.discovery_logout = <empty>
Jul 27 12:54:25 user nova-compute[70994]: node.discovery_address = <empty>
Jul 27 12:54:25 user nova-compute[70994]: node.discovery_port = 0
Jul 27 12:54:25 user nova-compute[70994]: node.discovery_type = static
Jul 27 12:54:25 user nova-compute[70994]: node.session.initial_cmdsn = 0
Jul 27 12:54:25 user nova-compute[70994]: node.session.initial_login_retry_max = 8
Jul 27 12:54:25 user nova-compute[70994]: node.session.xmit_thread_priority = -20
Jul 27 12:54:25 user nova-compute[70994]: node.session.cmds_max = 128
Jul 27 12:54:25 user nova-compute[70994]: node.session.queue_depth = 32
Jul 27 12:54:25 user nova-compute[70994]: node.session.nr_sessions = 1
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.authmethod = CHAP
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.username = qFXothwG
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.password = ***
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.username_in = <empty>
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.password_in = <empty>
Jul 27 12:54:25 user nova-compute[70994]: node.session.auth.chap_algs = MD5
Jul 27 12:54:25 user nova-compute[70994]: node.session.timeo.replacement_timeout = 120
Jul 27 12:54:25 user nova-compute[70994]: node.session.err_timeo.abort_timeout = 15
Jul 27 12:54:25 user nova-compute[70994]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 12:54:25 user nova-compute[70994]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 12:54:25 user nova-compute[70994]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.FastAbort = Yes
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.InitialR2T = No
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.ImmediateData = Yes
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.MaxConnections = 1
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 12:54:25 user nova-compute[70994]: node.session.iscsi.ERL = 0
Jul 27 12:54:25 user nova-compute[70994]: node.session.scan = manual
Jul 27 12:54:25 user nova-compute[70994]: node.session.reopen_max = 0
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].address = 172.16.0.220
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].port = 3260
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].startup = manual
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].tcp.window_size = 524288
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].tcp.type_of_service = 0
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].timeo.logout_timeout = 15
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].timeo.login_timeout = 15
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].timeo.auth_timeout = 45
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.DataDigest = None
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.IFMarker = No
Jul 27 12:54:25 user nova-compute[70994]: node.conn[0].iscsi.OFMarker = No
Jul 27 12:54:25 user nova-compute[70994]: # END RECORD
Jul 27 12:54:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae7005-90a7-41b6-a7e4-a93d4737432d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a57fc9-92f2-436d-90c8-28c4b3050b6d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFXothwG {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFXothwG" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd001e5-f963-4ee0-95a7-e85fb25caaea]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFXothwG'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c196c0-25d7-4a6a-b72c-79fe8025a6fa]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2065582-2439-45db-aaef-3015b643bfe0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:25 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:25 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:25 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:25 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:25 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa98c4-c7e7-44d3-afe7-94e466b9adab]: (4, ('0 0 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23037646537336536', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037646537336536', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1001634945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1001634945',id=30,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-hoop5re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:52:49Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=63c995b0-7c07-4651-9aff-de708915f027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:00:04:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "vif_mac": "fa:16:3e:00:04:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.objects.instance [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'pci_devices' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:54:25 user nova-compute[70994]:   <uuid>63c995b0-7c07-4651-9aff-de708915f027</uuid>
Jul 27 12:54:25 user nova-compute[70994]:   <name>instance-0000001e</name>
Jul 27 12:54:25 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:54:25 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:54:25 user nova-compute[70994]:   <metadata>
Jul 27 12:54:25 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:54:25 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1001634945</nova:name>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:54:25</nova:creationTime>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:54:25 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:54:25 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:owner>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:user uuid="593a7d28021a47b491c7fa86af3edc80">tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member</nova:user>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:project uuid="f3cd4ff8af2445179cc6ba07c251dd4c">tempest-ServerBootFromVolumeStableRescueTest-859808530</nova:project>
Jul 27 12:54:25 user nova-compute[70994]:       </nova:owner>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:54:25 user nova-compute[70994]:       <nova:ports>
Jul 27 12:54:25 user nova-compute[70994]:         <nova:port uuid="917035e3-4e6b-4783-905f-db9070bc02cf">
Jul 27 12:54:25 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 12:54:25 user nova-compute[70994]:         </nova:port>
Jul 27 12:54:25 user nova-compute[70994]:       </nova:ports>
Jul 27 12:54:25 user nova-compute[70994]:     </nova:instance>
Jul 27 12:54:25 user nova-compute[70994]:   </metadata>
Jul 27 12:54:25 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:54:25 user nova-compute[70994]:     <system>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="serial">63c995b0-7c07-4651-9aff-de708915f027</entry>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="uuid">63c995b0-7c07-4651-9aff-de708915f027</entry>
Jul 27 12:54:25 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:54:25 user nova-compute[70994]:     </system>
Jul 27 12:54:25 user nova-compute[70994]:   </sysinfo>
Jul 27 12:54:25 user nova-compute[70994]:   <os>
Jul 27 12:54:25 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:54:25 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:54:25 user nova-compute[70994]:   </os>
Jul 27 12:54:25 user nova-compute[70994]:   <features>
Jul 27 12:54:25 user nova-compute[70994]:     <acpi/>
Jul 27 12:54:25 user nova-compute[70994]:     <apic/>
Jul 27 12:54:25 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:54:25 user nova-compute[70994]:   </features>
Jul 27 12:54:25 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:54:25 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:54:25 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:54:25 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:54:25 user nova-compute[70994]:   </clock>
Jul 27 12:54:25 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:54:25 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:54:25 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:54:25 user nova-compute[70994]:   </cpu>
Jul 27 12:54:25 user nova-compute[70994]:   <devices>
Jul 27 12:54:25 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:54:25 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:54:25 user nova-compute[70994]:       <source dev="/dev/sdb"/>
Jul 27 12:54:25 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:54:25 user nova-compute[70994]:       <serial>c4e1e910-1997-43d0-a27d-166b0da33dde</serial>
Jul 27 12:54:25 user nova-compute[70994]:     </disk>
Jul 27 12:54:25 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:54:25 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:54:25 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue"/>
Jul 27 12:54:25 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:54:25 user nova-compute[70994]:       <boot order="1"/>
Jul 27 12:54:25 user nova-compute[70994]:     </disk>
Jul 27 12:54:25 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:54:25 user nova-compute[70994]:       <mac address="fa:16:3e:00:04:a3"/>
Jul 27 12:54:25 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:54:25 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:54:25 user nova-compute[70994]:       <target dev="tap917035e3-4e"/>
Jul 27 12:54:25 user nova-compute[70994]:     </interface>
Jul 27 12:54:25 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:54:25 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/console.log" append="off"/>
Jul 27 12:54:25 user nova-compute[70994]:     </serial>
Jul 27 12:54:25 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:54:25 user nova-compute[70994]:     <video>
Jul 27 12:54:25 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:54:25 user nova-compute[70994]:     </video>
Jul 27 12:54:25 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:54:25 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:54:25 user nova-compute[70994]:     </rng>
Jul 27 12:54:25 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:54:25 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:54:25 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:54:25 user nova-compute[70994]:     </memballoon>
Jul 27 12:54:25 user nova-compute[70994]:   </devices>
Jul 27 12:54:25 user nova-compute[70994]: </domain>
Jul 27 12:54:25 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:54:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance destroyed successfully.
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] No VIF found with MAC fa:16:3e:00:04:a3, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:54:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:27 user nova-compute[70994]: WARNING nova.compute.manager [req-08aec528-ff0e-44a0-af47-c15289428deb req-771178bc-d74b-4bb1-ae82-c50b287b7565 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state active and task_state rescuing.
Jul 27 12:54:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:29 user nova-compute[70994]: WARNING nova.compute.manager [req-47416d59-6f45-4bfb-861e-f7b28f5d490c req-c6b5a758-3dec-4d4f-bdf3-c215d9da9e05 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state active and task_state rescuing.
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 63c995b0-7c07-4651-9aff-de708915f027 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462469.2771907, 63c995b0-7c07-4651-9aff-de708915f027 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:54:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Resumed (Lifecycle Event)
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3fcadba9-a143-483f-a27f-7489574ed3a2 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:54:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462469.2802677, 63c995b0-7c07-4651-9aff-de708915f027 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:54:29 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Started (Lifecycle Event)
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMpLbhgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:29 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:29 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:29 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd11a1ec-cd4b-4649-8656-afe9718cb9d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:54:29 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c01373d-9128-4e69-ad1e-6df8ce4c82e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe] added
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e2980-7976-4d63-b77b-6e296d45745e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa846b0-d5ac-4fb3-9eeb-fd5294d2a771]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMpLbhgd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMpLbhgd" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8512bdd0-5401-4d48-a75b-ecde4cef430e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IMpLbhgd'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da7b25-ae42-47d5-9b77-2028be35a1e9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8491b0d8-217c-44a8-8fd3-1c4edced7755]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c166efb9-1fda-45f8-a3e6-63d44ab8bda0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260]
Jul 27 12:54:30 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260] successful.
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220c4f9-85b4-42ca-a8d8-d4ae57212340]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e6600e-a08a-4721-b307-1232113b0167]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:30 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:30 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9744f3-78d3-4f81-9e36-939a5d90ec61]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:30 user nova-compute[70994]: INFO nova.compute.manager [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Terminating instance
Jul 27 12:54:30 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.compute.manager [req-e9382146-b1d3-46de-adc4-e73953ac2603 req-06e45787-e6ef-47e0-a39d-e7ccf239b736 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-unplugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMpLbhgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23437633132636631', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633132636631', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.objects.instance [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:54:31 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:54:31 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:54:31 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:54:31 user nova-compute[70994]:   <serial>aed26a91-717e-4f48-a836-e9d3137a9dbe</serial>
Jul 27 12:54:31 user nova-compute[70994]: </disk>
Jul 27 12:54:31 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:54:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Instance destroyed successfully.
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lazy-loading 'resources' on Instance uuid f9432eac-732b-4dcc-b8af-abb390b7cb55 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1006968374',display_name='tempest-ServerStableDeviceRescueTest-server-1006968374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1006968374',id=22,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9cAQdEUwCjJ5NO/sU7pixKf7Ep1zH+79GJq+9pKHMOmoNI5F/OrHSlARsbOP9FjCl/CzuGGo0+IHt60ofxd4AqnC0785A6FFyW+GyYs7Je9M0sRHs9yyg058u3CDXiMQ==',key_name='tempest-keypair-1267023795',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:51:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bf2ec7ac6ff456eb3ef1f52241a742e',ramdisk_id='',reservation_id='r-d3aagtse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-373928889',owner_user_name='tempest-ServerStableDeviceRescueTest-373928889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f8edd1555a642b8b776aa6d329a1eaa',uuid=f9432eac-732b-4dcc-b8af-abb390b7cb55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converting VIF {"id": "33013b4d-599e-46b0-9f2d-446217b3e442", "address": "fa:16:3e:44:3f:08", "network": {"id": "5ce12cdf-9bec-44f3-b372-061604a89f11", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2144854082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bf2ec7ac6ff456eb3ef1f52241a742e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33013b4d-59", "ovs_interfaceid": "33013b4d-599e-46b0-9f2d-446217b3e442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG os_vif [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33013b4d-59, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:32 user nova-compute[70994]: INFO os_vif [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:3f:08,bridge_name='br-int',has_traffic_filtering=True,id=33013b4d-599e-46b0-9f2d-446217b3e442,network=Network(5ce12cdf-9bec-44f3-b372-061604a89f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33013b4d-59')
Jul 27 12:54:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Deleting instance files /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55_del
Jul 27 12:54:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Deletion of /opt/stack/data/nova/instances/f9432eac-732b-4dcc-b8af-abb390b7cb55_del complete
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No VIF found with MAC fa:16:3e:aa:0d:62, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:54:32 user nova-compute[70994]: INFO nova.compute.manager [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 27 12:54:32 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:54:32 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-9de3c1c0-db37-41ec-b1ed-bf17bbdc23d3 tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.240s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] Acquiring lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:33 user nova-compute[70994]: DEBUG nova.compute.manager [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] No waiting events found dispatching network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:33 user nova-compute[70994]: WARNING nova.compute.manager [req-3a0d288a-9a61-4747-a763-41b7d316d262 req-fd2dfe9c-4502-417e-b44f-06ec0c7d5f78 service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received unexpected event network-vif-plugged-33013b4d-599e-46b0-9f2d-446217b3e442 for instance with vm_state active and task_state deleting.
Jul 27 12:54:33 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:33 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Took 1.71 seconds to deallocate network for instance.
Jul 27 12:54:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:34 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:54:34 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:54:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:34 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Deleted allocations for instance f9432eac-732b-4dcc-b8af-abb390b7cb55
Jul 27 12:54:34 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b71a1f2c-94c9-419a-af41-7034a83beaa4 tempest-ServerStableDeviceRescueTest-373928889 tempest-ServerStableDeviceRescueTest-373928889-project-member] Lock "f9432eac-732b-4dcc-b8af-abb390b7cb55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.872s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:54:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-5af453f3-bec2-4e5d-9d2c-6883480b351e req-ae66f0af-0785-48a8-b68b-298c9cd4bebb service nova] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Received event network-vif-deleted-33013b4d-599e-46b0-9f2d-446217b3e442 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:36 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [{"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:36 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-537420c1-3f63-4dd9-ad48-cd5c1d8247dc" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:54:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:54:36 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:36 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462461.6496372, b5a77277-e67a-4d4f-9203-36ec4040f373 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:54:36 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] VM Stopped (Lifecycle Event)
Jul 27 12:54:36 user nova-compute[70994]: DEBUG nova.compute.manager [None req-3705465b-c986-4309-ab63-57aadf25e4f9 None None] [instance: b5a77277-e67a-4d4f-9203-36ec4040f373] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:54:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:54:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7450MB free_disk=25.15286636352539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e31094ff-43ca-4256-a933-25ee73995818 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance e24b9029-64dc-4b6b-ad8d-94f021bee52e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3c59a3aa-d360-4783-89a3-000edfce0e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing inventories for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating ProviderTree inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing aggregate associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, aggregates: None {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 12:54:44 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing trait associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 12:54:45 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:54:45 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:54:45 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:54:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462472.0961914, f9432eac-732b-4dcc-b8af-abb390b7cb55 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:54:47 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] VM Stopped (Lifecycle Event)
Jul 27 12:54:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d948224e-f405-4d0d-8f0f-1aa7b2ba3e2b None None] [instance: f9432eac-732b-4dcc-b8af-abb390b7cb55] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:54:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG nova.objects.instance [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'flavor' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:49 user nova-compute[70994]: INFO nova.compute.manager [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Attaching volume 358b1236-d481-4d83-b1cd-5109ba9b808b to /dev/vdb
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.utils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e8380-aed8-412c-920a-afbcd93fe5b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce376692-780e-4854-ba19-a7c025e4c1cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8f2f2-4386-42bf-99b3-40861f0503a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce76c2-cf4b-479e-9a5e-60dd32325a82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:54:49 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:54:49 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9218f21-aa32-4260-8307-ced803bfa1c0]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG os_brick.utils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:49 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating existing volume attachment record: d674070b-6cc1-4091-aaca-9c5cfc832fe7 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:50 user nova-compute[70994]: INFO nova.compute.manager [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Terminating instance
Jul 27 12:54:50 user nova-compute[70994]: DEBUG nova.compute.manager [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-d094139d-854e-4641-a04c-22f0192faa41 req-1eafbe0a-2bea-445e-b0db-a239775ce6fb service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-unplugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:54:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Instance destroyed successfully.
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.objects.instance [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'resources' on Instance uuid 537420c1-3f63-4dd9-ad48-cd5c1d8247dc {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-533728173',display_name='tempest-ServerActionsTestOtherA-server-533728173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-533728173',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:50:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-enash8qe',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:52:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=537420c1-3f63-4dd9-ad48-cd5c1d8247dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "a65b020f-1b45-4235-95ec-22d237d2d66d", "address": "fa:16:3e:6b:36:bb", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65b020f-1b", "ovs_interfaceid": "a65b020f-1b45-4235-95ec-22d237d2d66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_vif [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65b020f-1b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:51 user nova-compute[70994]: INFO os_vif [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:bb,bridge_name='br-int',has_traffic_filtering=True,id=a65b020f-1b45-4235-95ec-22d237d2d66d,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65b020f-1b')
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsXRTqiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:51 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a44ea-8554-499a-bd43-d7ebf5543996]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:54:51 user nova-compute[70994]: No targets found.
Jul 27 12:54:51 user nova-compute[70994]: iSNS:
Jul 27 12:54:51 user nova-compute[70994]: No targets found.
Jul 27 12:54:51 user nova-compute[70994]: STATIC:
Jul 27 12:54:51 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:54:51 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:51 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:51 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625
Jul 27 12:54:51 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:51 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:51 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe
Jul 27 12:54:51 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:51 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:51 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:54:51 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:54:51 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:54:51 user nova-compute[70994]: FIRMWARE:
Jul 27 12:54:51 user nova-compute[70994]: No targets found.
Jul 27 12:54:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:54:51 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:54:51 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1953b792-7d44-497a-bc3e-31870fa5dc3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c914da12-28f2-48e2-b9b4-a63e1f9289c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:51 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f412b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bc9ba7-e9fb-40c1-9577-fecc12f4a3d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f890e-6164-404e-a8fc-f9a7fe653be3]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2142c6-c476-4fdc-b18d-abbef3251ef2]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c1a1f-9c0d-453b-bcbb-9caa9ce71a48]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23931653732316339', '/dev/disk/by-id/scsi-1SCST_BIO4239e28b-91e721c9f41e89cd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4239e28b') {{(pid=82465) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09183d2b-58e4-43e0-a70d-2feec62ad627]: (4, None) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3155ba-7516-44b4-b8bb-33f39d2db0bc]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c956c26-3aca-455e-9ec0-7ab88aa63157]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260]
Jul 27 12:54:51 user nova-compute[70994]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625, portal: 172.16.0.220,3260] successful.
Jul 27 12:54:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82253e41-1032-4b7f-8b32-91176983d625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68b585-bd01-4a3e-9307-bc6fa29d5e56]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] <== disconnect_volume: return (445ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:54:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Deleting instance files /opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc_del
Jul 27 12:54:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Deletion of /opt/stack/data/nova/instances/537420c1-3f63-4dd9-ad48-cd5c1d8247dc_del complete
Jul 27 12:54:51 user nova-compute[70994]: INFO nova.compute.manager [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 27 12:54:51 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:54:51 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] Acquiring lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] No waiting events found dispatching network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:53 user nova-compute[70994]: WARNING nova.compute.manager [req-563c8d53-1691-40a8-a41f-82f17f07e7b6 req-36ba89f8-eb76-4b57-b6fe-1ee65e8fc4ef service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received unexpected event network-vif-plugged-a65b020f-1b45-4235-95ec-22d237d2d66d for instance with vm_state active and task_state deleting.
Jul 27 12:54:53 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:53 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Took 1.20 seconds to deallocate network for instance.
Jul 27 12:54:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-2219a08c-095a-4c04-9e1a-b2c5232cdbce req-dacb1a89-01c9-46f7-8dad-5e2529e7b78d service nova] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Received event network-vif-deleted-a65b020f-1b45-4235-95ec-22d237d2d66d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:53 user nova-compute[70994]: INFO nova.compute.manager [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Took 0.82 seconds to detach 1 volumes for instance.
Jul 27 12:54:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Deleting volume: 82253e41-1032-4b7f-8b32-91176983d625 {{(pid=70994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 12:54:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:54 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:54:54 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:54:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:54 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Deleted allocations for instance 537420c1-3f63-4dd9-ad48-cd5c1d8247dc
Jul 27 12:54:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-779d67cf-d9bd-470c-8e7f-e35b044f59c3 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "537420c1-3f63-4dd9-ad48-cd5c1d8247dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.196s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:55 user nova-compute[70994]: INFO nova.compute.manager [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Terminating instance
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-unplugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] No waiting events found dispatching network-vif-unplugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-db6d166d-13e8-4bfd-9101-31974370bab3 req-06616670-2047-4827-a045-0400e299622f service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-unplugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:54:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Instance destroyed successfully.
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.objects.instance [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'resources' on Instance uuid e24b9029-64dc-4b6b-ad8d-94f021bee52e {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1144710596',display_name='tempest-AttachVolumeNegativeTest-server-1144710596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1144710596',id=27,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3S+SLXIyaushSkuE5VhvjPn2cR+ny1AxvCloNkmCv/HUJHHwsDfJ2VGghydVB8xhiRBW2mFpyK5fzAPxIvep5S5c1MhnSK86xXYBKYJQFTPsC45+Mu17SK8v4N3T6b9w==',key_name='tempest-keypair-886999848',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-9ynto34a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=e24b9029-64dc-4b6b-ad8d-94f021bee52e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "address": "fa:16:3e:a0:be:5b", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01b53b1-b7", "ovs_interfaceid": "e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG os_vif [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape01b53b1-b7, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:55 user nova-compute[70994]: INFO os_vif [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01b53b1-b7')
Jul 27 12:54:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Deleting instance files /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e_del
Jul 27 12:54:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Deletion of /opt/stack/data/nova/instances/e24b9029-64dc-4b6b-ad8d-94f021bee52e_del complete
Jul 27 12:54:55 user nova-compute[70994]: INFO nova.compute.manager [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 12:54:55 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:54:55 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:54:57 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:57 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:54:57 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcbd54-5c4a-462e-8950-87137fcacad7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:54:57 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8845bd-14e1-4cb0-84cd-c4d657b72de8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b] added
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09c379-b257-4231-9efd-f86afbf8a1c9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[47988498-8d8c-43f5-b09e-4c6f851ac96a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzMmlbWd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzMmlbWd" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58f723-52c8-4757-9f66-8254586b866a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzMmlbWd'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[be28375b-7ed3-44ef-83c2-fd3c9e57e47a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] Acquiring lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] No waiting events found dispatching network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:54:57 user nova-compute[70994]: WARNING nova.compute.manager [req-c4da2c2a-2418-48b9-8417-bd3b1bcb2fe4 req-4972488d-84f4-4ed1-8f46-3ec4d5e4c9d7 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received unexpected event network-vif-plugged-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 for instance with vm_state active and task_state deleting.
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a20d8ba-0da2-4852-b991-67205223a5dd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a9b9f-5650-4037-ac4b-57860d875523]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]
Jul 27 12:54:57 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d683c-7bb6-49ea-8c6e-b5228b22607e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a2c9f-f699-44f7-9f99-b414bdffb311]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:54:57 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:54:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea19d9-92c9-452b-b60a-89cabefeffad]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:54:57 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Took 1.73 seconds to deallocate network for instance.
Jul 27 12:54:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-a230edfb-570f-41e2-a64e-eaa68b799d1d req-e65ffe15-ee1b-4247-8659-23067f5f2d01 service nova] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Received event network-vif-deleted-e01b53b1-b70a-4f3b-8ccb-d70b5b1caee0 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:54:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:58 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Deleted allocations for instance e24b9029-64dc-4b6b-ad8d-94f021bee52e
Jul 27 12:54:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8c8c52dc-6297-48a4-b19b-958917f3f63c tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "e24b9029-64dc-4b6b-ad8d-94f021bee52e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23735656136363866', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735656136363866', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG nova.objects.instance [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'flavor' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:54:58 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:54:58 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:54:58 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:54:58 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:54:58 user nova-compute[70994]:   <serial>358b1236-d481-4d83-b1cd-5109ba9b808b</serial>
Jul 27 12:54:58 user nova-compute[70994]: </disk>
Jul 27 12:54:58 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:54:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:54:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No VIF found with MAC fa:16:3e:85:2e:6b, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:54:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-78d76342-56b5-4d22-87e6-054a4b9296c4 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.829s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:04 user nova-compute[70994]: INFO nova.compute.manager [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Detaching volume aed26a91-717e-4f48-a836-e9d3137a9dbe
Jul 27 12:55:04 user nova-compute[70994]: INFO nova.virt.block_device [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Attempting to driver detach volume aed26a91-717e-4f48-a836-e9d3137a9dbe from mountpoint /dev/vdb
Jul 27 12:55:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Attempting to detach device vdb from instance 3c59a3aa-d360-4783-89a3-000edfce0e52 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:55:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:55:04 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:55:04 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:55:04 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:55:04 user nova-compute[70994]:   <serial>aed26a91-717e-4f48-a836-e9d3137a9dbe</serial>
Jul 27 12:55:04 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:55:04 user nova-compute[70994]: </disk>
Jul 27 12:55:04 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:55:04 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully detached device vdb from instance 3c59a3aa-d360-4783-89a3-000edfce0e52 from the persistent domain config.
Jul 27 12:55:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c59a3aa-d360-4783-89a3-000edfce0e52 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:55:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:55:04 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:55:04 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:55:04 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:55:04 user nova-compute[70994]:   <serial>aed26a91-717e-4f48-a836-e9d3137a9dbe</serial>
Jul 27 12:55:04 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:55:04 user nova-compute[70994]: </disk>
Jul 27 12:55:04 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462505.4253068, 3c59a3aa-d360-4783-89a3-000edfce0e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:55:05 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully detached device vdb from instance 3c59a3aa-d360-4783-89a3-000edfce0e52 from the live domain config.
Jul 27 12:55:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMpLbhgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:55:05 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260d034-c8ae-4c35-8211-c1e2038819ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:55:05 user nova-compute[70994]: No targets found.
Jul 27 12:55:05 user nova-compute[70994]: iSNS:
Jul 27 12:55:05 user nova-compute[70994]: No targets found.
Jul 27 12:55:05 user nova-compute[70994]: STATIC:
Jul 27 12:55:05 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:55:05 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:05 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:05 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b
Jul 27 12:55:05 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:05 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:05 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe
Jul 27 12:55:05 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:05 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:05 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:55:05 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:05 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:05 user nova-compute[70994]: FIRMWARE:
Jul 27 12:55:05 user nova-compute[70994]: No targets found.
Jul 27 12:55:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:55:05 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:55:05 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed01705b-2042-4d9f-8ceb-4cdec8009436]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dbdb69-f1d5-4a39-8e92-075f7b445a22]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe (non-flash)
Jul 27 12:55:05 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc47f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecb4b5c-aaee-41fb-91d2-9624b84fac0e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8880cc-49b9-423a-8e13-1036802d2b66]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60afe8-758e-48e8-b616-3b738478dc09]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d294ad1e-20bd-4a65-92a7-62991fb524f0]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42de577-0bed-4ad2-8b94-2ec249c545dd]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c03bf-98c7-47f5-9928-5f3b8ef67d0d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260]
Jul 27 12:55:05 user nova-compute[70994]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe, portal: 172.16.0.220,3260] successful.
Jul 27 12:55:05 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d190b5-81fe-44f8-bb29-484dd7cca5b6]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== disconnect_volume: return (315ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:55:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462491.3627646, 537420c1-3f63-4dd9-ad48-cd5c1d8247dc => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:06 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] VM Stopped (Lifecycle Event)
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-34cbb8d6-af4d-4810-ab92-f93b3bcdc774 None None] [instance: 537420c1-3f63-4dd9-ad48-cd5c1d8247dc] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.objects.instance [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-6495a507-8cf6-44af-b894-fc998a842daa tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.549s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:06 user nova-compute[70994]: INFO nova.compute.manager [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Terminating instance
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-unplugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] No waiting events found dispatching network-vif-unplugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-67a8d950-bb80-417f-9f74-63809fba1527 req-57613f08-7e3e-47c1-a53c-26212a87d34b service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-unplugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Instance destroyed successfully.
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'resources' on Instance uuid 3c59a3aa-d360-4783-89a3-000edfce0e52 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-37347075',display_name='tempest-VolumesSnapshotTestJSON-instance-37347075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-37347075',id=31,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHYylf4wHmLOTo7UnLI0ck5aWCK47Bb9KBKjDAhE6OPAkFGCyoVFVU1b9+8XOUtQpwC+5RdlGTSqMcqawrbc4R3u+mInTwNoI11/uPSVukPBKj9gtBj9zbsudri2poaw==',key_name='tempest-keypair-42927591',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-yx87goiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=3c59a3aa-d360-4783-89a3-000edfce0e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "address": "fa:16:3e:aa:0d:62", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fb80b2b-a9", "ovs_interfaceid": "0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_vif [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fb80b2b-a9, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:07 user nova-compute[70994]: INFO os_vif [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:0d:62,bridge_name='br-int',has_traffic_filtering=True,id=0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fb80b2b-a9')
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMpLbhgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:55:07 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[740824d9-294d-49aa-a276-8d5f665a9592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:55:07 user nova-compute[70994]: No targets found.
Jul 27 12:55:07 user nova-compute[70994]: iSNS:
Jul 27 12:55:07 user nova-compute[70994]: No targets found.
Jul 27 12:55:07 user nova-compute[70994]: STATIC:
Jul 27 12:55:07 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:55:07 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:07 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:07 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b
Jul 27 12:55:07 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:07 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:07 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:55:07 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:07 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:07 user nova-compute[70994]: FIRMWARE:
Jul 27 12:55:07 user nova-compute[70994]: No targets found.
Jul 27 12:55:07 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:55:07 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:55:07 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aed26a91-717e-4f48-a836-e9d3137a9dbe', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[364096a9-aed2-4fa5-9d32-07e9d8cff69e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd1e981-4619-47bf-9146-83ae92329265]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:07 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:07 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:07 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:07 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:07 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:07 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc727520>, {}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Disconnecting from: [] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.102s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== disconnect_volume: return (104ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:55:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Deleting instance files /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52_del
Jul 27 12:55:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Deletion of /opt/stack/data/nova/instances/3c59a3aa-d360-4783-89a3-000edfce0e52_del complete
Jul 27 12:55:07 user nova-compute[70994]: INFO nova.compute.manager [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 27 12:55:07 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:55:07 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing instance network info cache due to event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updated VIF entry in instance network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-74a8b17c-2bd9-4b41-b2ad-265f55a7ca6b req-9375fceb-9fb6-4bac-a22d-9d70013d0e08 service nova] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] Acquiring lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] No waiting events found dispatching network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:08 user nova-compute[70994]: WARNING nova.compute.manager [req-aa983af8-fe5b-4079-ad47-36ba628329f1 req-33a86228-acd1-49cb-a596-5aef0400f77e service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received unexpected event network-vif-plugged-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a for instance with vm_state active and task_state deleting.
Jul 27 12:55:09 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:09 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Took 1.55 seconds to deallocate network for instance.
Jul 27 12:55:09 user nova-compute[70994]: WARNING nova.volume.cinder [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Attachment 170320f3-9fa2-4748-8297-b819190ed673 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 170320f3-9fa2-4748-8297-b819190ed673. (HTTP 404) (Request-ID: req-98b8763e-993b-4f76-8321-d01d7b47523e)
Jul 27 12:55:09 user nova-compute[70994]: INFO nova.compute.manager [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 12:55:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:09 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:09 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:09 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Deleted allocations for instance 3c59a3aa-d360-4783-89a3-000edfce0e52
Jul 27 12:55:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-f8b64b1a-26f2-4ed1-88e6-49168a86bcbc tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "3c59a3aa-d360-4783-89a3-000edfce0e52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-f11a78c2-f5eb-4c12-b5f6-42977b9d04c9 req-44fcee4f-1c4c-4d1e-8581-bac4d6ca414a service nova] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Received event network-vif-deleted-0fb80b2b-a905-4ae9-ab2b-e7ae37ff4e4a {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:10 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462495.8182697, e24b9029-64dc-4b6b-ad8d-94f021bee52e => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:10 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] VM Stopped (Lifecycle Event)
Jul 27 12:55:10 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7c5685b9-485d-415c-934a-99a1978eda81 None None] [instance: e24b9029-64dc-4b6b-ad8d-94f021bee52e] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing instance network info cache due to event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updated VIF entry in instance network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7e96e09c-e2b4-4c7b-b38c-b06308a6b2dd req-d2cbdc53-f727-4cef-8a6d-318509b7f5cf service nova] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:55:16 user nova-compute[70994]: INFO nova.compute.claims [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Claim successful on node user
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:16 user nova-compute[70994]: INFO nova.compute.manager [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Rebooting instance
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:55:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:55:16 user nova-compute[70994]: DEBUG nova.policy [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c535c14a3340454fb65cce2e3e467d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f5aa65a2145df8ee4a41d50152d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:55:17 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Creating image(s)
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "/opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "/opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.157s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk 1073741824" returned: 0 in 0.057s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.171s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Successfully created port: 95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Cannot resize image /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'migration_context' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.compute.manager [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:17 user nova-compute[70994]: WARNING nova.compute.manager [req-5833f88c-761a-43dc-95f1-932d8fa50a4f req-1b380e07-8af8-4072-933f-3ae338af9137 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Ensure instance console log exists: /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:18 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance destroyed successfully.
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'resources' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:55:17Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8631dbc1-a0, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:18 user nova-compute[70994]: INFO os_vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0')
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:55:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[84509958-9389-4441-a78e-f9a267ed3906]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:55:18 user nova-compute[70994]: No targets found.
Jul 27 12:55:18 user nova-compute[70994]: iSNS:
Jul 27 12:55:18 user nova-compute[70994]: No targets found.
Jul 27 12:55:18 user nova-compute[70994]: STATIC:
Jul 27 12:55:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:55:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b
Jul 27 12:55:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:18 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:55:18 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:55:18 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:55:18 user nova-compute[70994]: FIRMWARE:
Jul 27 12:55:18 user nova-compute[70994]: No targets found.
Jul 27 12:55:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:55:18 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:55:18 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db29ed-6bc5-4029-940b-88de5778fa90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[053a490a-fec5-45bb-b63f-6623b1459070]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:18 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:18 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:18 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:18 user nova-compute[70994]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88dc47a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b48b01-4f3e-4fc7-b9df-9a11c4c9baa5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf7482-c5c9-469b-b142-586b1fec799a]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b50479-5c3b-4c1e-996f-b243d39f2ffb]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee61c899-0a39-488e-8523-4e711cad312f]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2134ca-4e70-4a09-8397-453331a2f49d]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8552560e-f74b-448b-892b-d259b2c32a71]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]
Jul 27 12:55:18 user nova-compute[70994]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.
Jul 27 12:55:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Successfully updated port: 95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb3eeb4-1049-4fe0-93b0-5d6fd1ca3215]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] <== disconnect_volume: return (332ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start _get_guest_xml network_info=[{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=93186396-f12e-4e28-a24d-9de7b7d114f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '93186396-f12e-4e28-a24d-9de7b7d114f0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3ae811b1-0975-42e0-82ab-be09c2c2ec11', 'attached_at': '', 'detached_at': '', 'volume_id': '358b1236-d481-4d83-b1cd-5109ba9b808b', 'serial': '358b1236-d481-4d83-b1cd-5109ba9b808b'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'd674070b-6cc1-4091-aaca-9c5cfc832fe7', 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquired lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:55:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:18 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-changed-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Refreshing instance network info cache due to event network-changed-95d8eb07-381d-4f1b-84d2-c5025edaebfc. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] Acquiring lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=93186396-f12e-4e28-a24d-9de7b7d114f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:55:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:55:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:55:18 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:55:18 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2369dccc-8a44-4a20-8473-10b8b9c5d974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:55:18 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3501b08-c2b3-45fa-80c3-962b753657d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b] added
Jul 27 12:55:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33298f3-177b-4503-b5d6-c9c6958c7240]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc8a00-a0e7-43b6-8e1b-4e7c0cc0f550]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzMmlbWd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzMmlbWd" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3358f061-be14-437d-91a3-92c8129d9c36]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzMmlbWd'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab7ac87-7140-4d4a-a62a-977c655d8a69]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd489ca3-d6ff-41a5-8e79-ef2ab4676d6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e95f8a-82ac-46a4-b1f1-7c035cbb56b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]
Jul 27 12:55:19 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.
Jul 27 12:55:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[836fc5f9-b9d2-404a-9254-f5af31bd588f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d1205-90e5-45f3-a9f8-2ba3794ba487]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:55:19 user nova-compute[70994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:55:19 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f0aa84-a928-4b63-a0d7-302986fd4917]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating instance_info_cache with network_info: [{"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Releasing lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Instance network_info: |[{"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] Acquired lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.neutron [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Refreshing network info cache for port 95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Start _get_guest_xml network_info=[{"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:55:19 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:19 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2055215645',display_name='tempest-TestServerVolumeAttachmentScenario-server-2055215645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2055215645',id=33,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL8D75iroqnJsjCO0gCUHdLtMcHF12uTmRZvv/0N18F3HRYY1HnL7C/T7QFamSRlUnBs9pxRbC7vZeyG9fYv9kePxfbP8N9vqyHfgB7e6XloUEIEOAHkC9LrwJp9qNKJw==',key_name='tempest-keypair-1907100483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='794f5aa65a2145df8ee4a41d50152d4a',ramdisk_id='',reservation_id='r-pzf8ukpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1338593503',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1338593503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c535c14a3340454fb65cce2e3e467d0d',uuid=f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converting VIF {"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'pci_devices' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:55:19 user nova-compute[70994]:   <uuid>f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72</uuid>
Jul 27 12:55:19 user nova-compute[70994]:   <name>instance-00000021</name>
Jul 27 12:55:19 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:55:19 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:55:19 user nova-compute[70994]:   <metadata>
Jul 27 12:55:19 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:55:19 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2055215645</nova:name>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:55:19</nova:creationTime>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:55:19 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:55:19 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:owner>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:user uuid="c535c14a3340454fb65cce2e3e467d0d">tempest-TestServerVolumeAttachmentScenario-1338593503-project-member</nova:user>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:project uuid="794f5aa65a2145df8ee4a41d50152d4a">tempest-TestServerVolumeAttachmentScenario-1338593503</nova:project>
Jul 27 12:55:19 user nova-compute[70994]:       </nova:owner>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:55:19 user nova-compute[70994]:       <nova:ports>
Jul 27 12:55:19 user nova-compute[70994]:         <nova:port uuid="95d8eb07-381d-4f1b-84d2-c5025edaebfc">
Jul 27 12:55:19 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 12:55:19 user nova-compute[70994]:         </nova:port>
Jul 27 12:55:19 user nova-compute[70994]:       </nova:ports>
Jul 27 12:55:19 user nova-compute[70994]:     </nova:instance>
Jul 27 12:55:19 user nova-compute[70994]:   </metadata>
Jul 27 12:55:19 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:55:19 user nova-compute[70994]:     <system>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="serial">f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72</entry>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="uuid">f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72</entry>
Jul 27 12:55:19 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:55:19 user nova-compute[70994]:     </system>
Jul 27 12:55:19 user nova-compute[70994]:   </sysinfo>
Jul 27 12:55:19 user nova-compute[70994]:   <os>
Jul 27 12:55:19 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:55:19 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:55:19 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:55:19 user nova-compute[70994]:   </os>
Jul 27 12:55:19 user nova-compute[70994]:   <features>
Jul 27 12:55:19 user nova-compute[70994]:     <acpi/>
Jul 27 12:55:19 user nova-compute[70994]:     <apic/>
Jul 27 12:55:19 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:55:19 user nova-compute[70994]:   </features>
Jul 27 12:55:19 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:55:19 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:55:19 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:55:19 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:55:19 user nova-compute[70994]:   </clock>
Jul 27 12:55:19 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:55:19 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:55:19 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:55:19 user nova-compute[70994]:   </cpu>
Jul 27 12:55:19 user nova-compute[70994]:   <devices>
Jul 27 12:55:19 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:55:19 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:55:19 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk"/>
Jul 27 12:55:19 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:55:19 user nova-compute[70994]:     </disk>
Jul 27 12:55:19 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:55:19 user nova-compute[70994]:       <mac address="fa:16:3e:c2:52:50"/>
Jul 27 12:55:19 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:19 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:55:19 user nova-compute[70994]:       <target dev="tap95d8eb07-38"/>
Jul 27 12:55:19 user nova-compute[70994]:     </interface>
Jul 27 12:55:19 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:55:19 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/console.log" append="off"/>
Jul 27 12:55:19 user nova-compute[70994]:     </serial>
Jul 27 12:55:19 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:55:19 user nova-compute[70994]:     <video>
Jul 27 12:55:19 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:19 user nova-compute[70994]:     </video>
Jul 27 12:55:19 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:55:19 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:55:19 user nova-compute[70994]:     </rng>
Jul 27 12:55:19 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:55:19 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:55:19 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:55:19 user nova-compute[70994]:     </memballoon>
Jul 27 12:55:19 user nova-compute[70994]:   </devices>
Jul 27 12:55:19 user nova-compute[70994]: </domain>
Jul 27 12:55:19 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2055215645',display_name='tempest-TestServerVolumeAttachmentScenario-server-2055215645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2055215645',id=33,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL8D75iroqnJsjCO0gCUHdLtMcHF12uTmRZvv/0N18F3HRYY1HnL7C/T7QFamSRlUnBs9pxRbC7vZeyG9fYv9kePxfbP8N9vqyHfgB7e6XloUEIEOAHkC9LrwJp9qNKJw==',key_name='tempest-keypair-1907100483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='794f5aa65a2145df8ee4a41d50152d4a',ramdisk_id='',reservation_id='r-pzf8ukpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1338593503',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1338593503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c535c14a3340454fb65cce2e3e467d0d',uuid=f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converting VIF {"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG os_vif [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95d8eb07-38, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95d8eb07-38, col_values=(('external_ids', {'iface-id': '95d8eb07-381d-4f1b-84d2-c5025edaebfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:52:50', 'vm-uuid': 'f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:19 user nova-compute[70994]: INFO os_vif [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38')
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No VIF found with MAC fa:16:3e:c2:52:50, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.neutron [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updated VIF entry in instance network info cache for port 95d8eb07-381d-4f1b-84d2-c5025edaebfc. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.network.neutron [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating instance_info_cache with network_info: [{"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9ca77182-3138-4e6c-a737-626ed7f09dbf req-c86ebff7-2bb9-417d-9ffe-2da0a5dd5738 service nova] Releasing lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:19 user nova-compute[70994]: DEBUG nova.compute.manager [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:19 user nova-compute[70994]: WARNING nova.compute.manager [req-7ca9b15c-0763-4bdb-a1a0-4a7b97df2911 req-3fb5a84f-5edd-46e3-85b0-a573bea38fa1 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 12:55:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23735656136363866', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735656136363866', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:55:17Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:55:20 user nova-compute[70994]:   <uuid>3ae811b1-0975-42e0-82ab-be09c2c2ec11</uuid>
Jul 27 12:55:20 user nova-compute[70994]:   <name>instance-00000020</name>
Jul 27 12:55:20 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:55:20 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:55:20 user nova-compute[70994]:   <metadata>
Jul 27 12:55:20 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:55:20 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:name>tempest-TestMinimumBasicScenario-server-519794403</nova:name>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:55:18</nova:creationTime>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:55:20 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:55:20 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:owner>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:user uuid="81685771daeb49bfbe069cb849e82adf">tempest-TestMinimumBasicScenario-312128031-project-member</nova:user>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:project uuid="92730f3b460c4f5c816d4aaad7645039">tempest-TestMinimumBasicScenario-312128031</nova:project>
Jul 27 12:55:20 user nova-compute[70994]:       </nova:owner>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:root type="image" uuid="93186396-f12e-4e28-a24d-9de7b7d114f0"/>
Jul 27 12:55:20 user nova-compute[70994]:       <nova:ports>
Jul 27 12:55:20 user nova-compute[70994]:         <nova:port uuid="8631dbc1-a0ad-4dc2-9734-094dc6fb5139">
Jul 27 12:55:20 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 12:55:20 user nova-compute[70994]:         </nova:port>
Jul 27 12:55:20 user nova-compute[70994]:       </nova:ports>
Jul 27 12:55:20 user nova-compute[70994]:     </nova:instance>
Jul 27 12:55:20 user nova-compute[70994]:   </metadata>
Jul 27 12:55:20 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:55:20 user nova-compute[70994]:     <system>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="serial">3ae811b1-0975-42e0-82ab-be09c2c2ec11</entry>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="uuid">3ae811b1-0975-42e0-82ab-be09c2c2ec11</entry>
Jul 27 12:55:20 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:55:20 user nova-compute[70994]:     </system>
Jul 27 12:55:20 user nova-compute[70994]:   </sysinfo>
Jul 27 12:55:20 user nova-compute[70994]:   <os>
Jul 27 12:55:20 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:55:20 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:55:20 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:55:20 user nova-compute[70994]:   </os>
Jul 27 12:55:20 user nova-compute[70994]:   <features>
Jul 27 12:55:20 user nova-compute[70994]:     <acpi/>
Jul 27 12:55:20 user nova-compute[70994]:     <apic/>
Jul 27 12:55:20 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:55:20 user nova-compute[70994]:   </features>
Jul 27 12:55:20 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:55:20 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:55:20 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:55:20 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:55:20 user nova-compute[70994]:   </clock>
Jul 27 12:55:20 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:55:20 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:55:20 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:55:20 user nova-compute[70994]:   </cpu>
Jul 27 12:55:20 user nova-compute[70994]:   <devices>
Jul 27 12:55:20 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:55:20 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:55:20 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk"/>
Jul 27 12:55:20 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:55:20 user nova-compute[70994]:     </disk>
Jul 27 12:55:20 user nova-compute[70994]:     <disk type="block" device="disk">
Jul 27 12:55:20 user nova-compute[70994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:55:20 user nova-compute[70994]:       <source dev="/dev/sdd"/>
Jul 27 12:55:20 user nova-compute[70994]:       <target dev="vdb" bus="virtio"/>
Jul 27 12:55:20 user nova-compute[70994]:       <serial>358b1236-d481-4d83-b1cd-5109ba9b808b</serial>
Jul 27 12:55:20 user nova-compute[70994]:     </disk>
Jul 27 12:55:20 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:55:20 user nova-compute[70994]:       <mac address="fa:16:3e:85:2e:6b"/>
Jul 27 12:55:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:20 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:55:20 user nova-compute[70994]:       <target dev="tap8631dbc1-a0"/>
Jul 27 12:55:20 user nova-compute[70994]:     </interface>
Jul 27 12:55:20 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:55:20 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/console.log" append="off"/>
Jul 27 12:55:20 user nova-compute[70994]:     </serial>
Jul 27 12:55:20 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:55:20 user nova-compute[70994]:     <video>
Jul 27 12:55:20 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:20 user nova-compute[70994]:     </video>
Jul 27 12:55:20 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:55:20 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:55:20 user nova-compute[70994]:     </rng>
Jul 27 12:55:20 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:55:20 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:55:20 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:55:20 user nova-compute[70994]:     </memballoon>
Jul 27 12:55:20 user nova-compute[70994]:   </devices>
Jul 27 12:55:20 user nova-compute[70994]: </domain>
Jul 27 12:55:20 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3a2ad7792eda922cd5570b98c2d9eff31f57985 --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Cannot resize image /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'migration_context' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:55:17Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG os_vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8631dbc1-a0, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8631dbc1-a0, col_values=(('external_ids', {'iface-id': '8631dbc1-a0ad-4dc2-9734-094dc6fb5139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:2e:6b', 'vm-uuid': '3ae811b1-0975-42e0-82ab-be09c2c2ec11'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:20 user nova-compute[70994]: INFO os_vif [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0')
Jul 27 12:55:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] No waiting events found dispatching network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:21 user nova-compute[70994]: WARNING nova.compute.manager [req-5d6cf436-ce69-46f5-a8af-9d42749367ca req-b6585b0e-0d4b-4123-91bc-5bd4af21b277 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received unexpected event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc for instance with vm_state building and task_state spawning.
Jul 27 12:55:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462507.3519883, 3c59a3aa-d360-4783-89a3-000edfce0e52 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:22 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] VM Stopped (Lifecycle Event)
Jul 27 12:55:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e3f76a12-d634-4b1b-932b-baefb304fb6b None None] [instance: 3c59a3aa-d360-4783-89a3-000edfce0e52] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:22 user nova-compute[70994]: DEBUG nova.compute.manager [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:22 user nova-compute[70994]: WARNING nova.compute.manager [req-dc05060c-5482-43ed-bab2-1e7bfe2c2558 req-11e1de28-7fd6-4037-b2c6-f3510aab591f service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 12:55:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] No waiting events found dispatching network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:23 user nova-compute[70994]: WARNING nova.compute.manager [req-62f49cdf-14a4-4242-ba14-0f56c7bb0deb req-5465a94f-d39f-48fa-b122-fa23063fa695 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received unexpected event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc for instance with vm_state building and task_state spawning.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462524.3984945, f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] VM Resumed (Lifecycle Event)
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Instance spawned successfully.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462524.405375, f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] VM Started (Lifecycle Event)
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Took 7.47 seconds to spawn the instance on the hypervisor.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Took 8.32 seconds to build instance.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-822545e4-e34e-43da-a700-8bec1b3ef44e tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.448s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 3ae811b1-0975-42e0-82ab-be09c2c2ec11 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462524.88912, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] VM Resumed (Lifecycle Event)
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:24 user nova-compute[70994]: WARNING nova.compute.manager [req-e32d9250-184a-4ed7-975a-6ad4450b1659 req-89638fb9-514b-4ab6-8f16-1b3b1d293132 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance rebooted successfully.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462524.8945787, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:24 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] VM Started (Lifecycle Event)
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:24 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-b09660d4-d5c1-448e-bad3-4c20654ec699 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.376s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:25 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:25 user nova-compute[70994]: INFO nova.compute.manager [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Terminating instance
Jul 27 12:55:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.compute.manager [req-1ac1675d-f9e1-43de-8e49-c7325a3951f9 req-3e358608-1dc5-4078-9ccc-ac0f91d95313 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-unplugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Instance destroyed successfully.
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid e31094ff-43ca-4256-a933-25ee73995818 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-365758352',display_name='tempest-ServerRescueNegativeTestJSON-server-365758352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-365758352',id=3,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-p5w2b089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:10Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=e31094ff-43ca-4256-a933-25ee73995818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "address": "fa:16:3e:24:04:48", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9ac57f-02", "ovs_interfaceid": "6c9ac57f-028b-466a-bb8f-5b74e174dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG os_vif [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9ac57f-02, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:26 user nova-compute[70994]: INFO os_vif [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:04:48,bridge_name='br-int',has_traffic_filtering=True,id=6c9ac57f-028b-466a-bb8f-5b74e174dcd6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9ac57f-02')
Jul 27 12:55:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Deleting instance files /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818_del
Jul 27 12:55:26 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Deletion of /opt/stack/data/nova/instances/e31094ff-43ca-4256-a933-25ee73995818_del complete
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: INFO nova.compute.manager [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: e31094ff-43ca-4256-a933-25ee73995818] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 27 12:55:26 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:27 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] Took 0.87 seconds to deallocate network for instance.
Jul 27 12:55:27 user nova-compute[70994]: DEBUG nova.compute.manager [req-30517006-9f67-4232-b596-0faea4a26d09 req-ecb0139d-7875-442b-a067-ea7e665d27d9 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-deleted-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:27 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Deleted allocations for instance e31094ff-43ca-4256-a933-25ee73995818
Jul 27 12:55:27 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a1f90881-51fc-46b2-a984-20e6d1fdc6f2 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "e31094ff-43ca-4256-a933-25ee73995818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:28 user nova-compute[70994]: WARNING nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state deleted and task_state None.
Jul 27 12:55:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Acquiring lock "e31094ff-43ca-4256-a933-25ee73995818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] Lock "e31094ff-43ca-4256-a933-25ee73995818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:28 user nova-compute[70994]: DEBUG nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] No waiting events found dispatching network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:28 user nova-compute[70994]: WARNING nova.compute.manager [req-0d654b87-64cb-49c2-b25c-9fdc1945a903 req-30151f6f-b171-4b4c-b61c-5d11d7160635 service nova] [instance: e31094ff-43ca-4256-a933-25ee73995818] Received unexpected event network-vif-plugged-6c9ac57f-028b-466a-bb8f-5b74e174dcd6 for instance with vm_state deleted and task_state None.
Jul 27 12:55:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Rebuilding the list of instances to heal {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lazy-loading 'info_cache' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [{"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:55:37 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462526.1059458, e31094ff-43ca-4256-a933-25ee73995818 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:41 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: e31094ff-43ca-4256-a933-25ee73995818] VM Stopped (Lifecycle Event)
Jul 27 12:55:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-f5af9ff7-da6a-4730-ac64-b51483935c13 None None] [instance: e31094ff-43ca-4256-a933-25ee73995818] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:55:41 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:55:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:43 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.193450927734375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:55:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:55:47 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:48 user nova-compute[70994]: INFO nova.compute.manager [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Terminating instance
Jul 27 12:55:48 user nova-compute[70994]: DEBUG nova.compute.manager [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-2ed27952-9437-4cbb-9f7f-c9b2dc48d6ba req-19fc6425-8714-4066-b7b6-5adeae996360 service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Instance destroyed successfully.
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.objects.instance [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lazy-loading 'resources' on Instance uuid 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T12:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950997778',display_name='tempest-ServerActionsTestOtherA-server-1695214911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950997778',id=8,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq4CaC/jfVLINF3/H+7zJymhrMEX5tEPjV4S1DVLpaT47uCQGpnLE2miMy6uOaHsQT82iMDNvVvT/MH+yrNP6VYDxVtH4TxXRwvrPd3dO12iHFyiSQzW9cOJ8Vms8JWrA==',key_name='tempest-keypair-8018971',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dba79eb748dd4e26b0be6a26705bda45',ramdisk_id='',reservation_id='r-5g5vaik9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1320950418',owner_user_name='tempest-ServerActionsTestOtherA-1320950418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e02d7aebd3e46beb2f554956eb3804c',uuid=7ae0f3cc-df1c-4427-9ab7-c7f0171de791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converting VIF {"id": "5389c431-e670-4b72-9d85-ff6cf932bd22", "address": "fa:16:3e:23:46:4b", "network": {"id": "bdfd503c-f8c9-4f73-af42-63e82bc2b66a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-132702124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dba79eb748dd4e26b0be6a26705bda45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5389c431-e6", "ovs_interfaceid": "5389c431-e670-4b72-9d85-ff6cf932bd22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG os_vif [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5389c431-e6, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:49 user nova-compute[70994]: INFO os_vif [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:46:4b,bridge_name='br-int',has_traffic_filtering=True,id=5389c431-e670-4b72-9d85-ff6cf932bd22,network=Network(bdfd503c-f8c9-4f73-af42-63e82bc2b66a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5389c431-e6')
Jul 27 12:55:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Deleting instance files /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791_del
Jul 27 12:55:49 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Deletion of /opt/stack/data/nova/instances/7ae0f3cc-df1c-4427-9ab7-c7f0171de791_del complete
Jul 27 12:55:49 user nova-compute[70994]: INFO nova.compute.manager [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 27 12:55:49 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:55:49 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Took 0.81 seconds to deallocate network for instance.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-b2878a4b-b33f-4582-92a4-dfff77a19927 req-844c8b46-6e31-4ed3-8838-848477fabf5f service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-deleted-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.333s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:55:50 user nova-compute[70994]: INFO nova.compute.claims [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Claim successful on node user
Jul 27 12:55:50 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Deleted allocations for instance 7ae0f3cc-df1c-4427-9ab7-c7f0171de791
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:50 user nova-compute[70994]: WARNING nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state deleted and task_state None.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:50 user nova-compute[70994]: WARNING nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state deleted and task_state None.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:50 user nova-compute[70994]: WARNING nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state deleted and task_state None.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:50 user nova-compute[70994]: WARNING nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-unplugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state deleted and task_state None.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Acquiring lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] No waiting events found dispatching network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:50 user nova-compute[70994]: WARNING nova.compute.manager [req-53a15771-3b0b-46ce-8255-1634d535f704 req-c422bab4-9515-4861-9bf4-32f5c52b710d service nova] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Received unexpected event network-vif-plugged-5389c431-e670-4b72-9d85-ff6cf932bd22 for instance with vm_state deleted and task_state None.
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-d13ada29-b202-49c0-9838-b155860897d5 tempest-ServerActionsTestOtherA-1320950418 tempest-ServerActionsTestOtherA-1320950418-project-member] Lock "7ae0f3cc-df1c-4427-9ab7-c7f0171de791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:50 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:55:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.policy [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f01edb66ab454f91812588fe77761874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620a0246ab1483d95c9f00fe7911b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:55:51 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Creating image(s)
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "/opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk 1073741824" returned: 0 in 0.053s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Cannot resize image /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.objects.instance [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'migration_context' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Successfully created port: 240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Ensure instance console log exists: /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:51 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Successfully updated port: 240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquired lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-changed-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG nova.compute.manager [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Refreshing instance network info cache due to event network-changed-240463f9-7ebb-4f8e-a570-4089967326f2. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] Acquiring lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:55:52 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.neutron [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updating instance_info_cache with network_info: [{"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Releasing lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Instance network_info: |[{"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] Acquired lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Refreshing network info cache for port 240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Start _get_guest_xml network_info=[{"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:53 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:53 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1731753672',display_name='tempest-AttachVolumeNegativeTest-server-1731753672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1731753672',id=34,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJBlgt6DJVlBcHlvkIQb2eZHo70vGVXPtZv5zzBV/yIE5IqFPADak6S8M3gEdrh1j+stg/IhLruKUsPfacZPMDzNzF951ETAVdPW5zdCAW/RyiBNPAxRIyoFYVEcD4hdg==',key_name='tempest-keypair-1463066970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-c0ri608c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=1972c076-947c-4b1e-96bd-098922378366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.objects.instance [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'pci_devices' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:55:53 user nova-compute[70994]:   <uuid>1972c076-947c-4b1e-96bd-098922378366</uuid>
Jul 27 12:55:53 user nova-compute[70994]:   <name>instance-00000022</name>
Jul 27 12:55:53 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:55:53 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:55:53 user nova-compute[70994]:   <metadata>
Jul 27 12:55:53 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:55:53 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1731753672</nova:name>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:55:53</nova:creationTime>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:55:53 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:55:53 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:owner>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:user uuid="f01edb66ab454f91812588fe77761874">tempest-AttachVolumeNegativeTest-1889965975-project-member</nova:user>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:project uuid="b620a0246ab1483d95c9f00fe7911b14">tempest-AttachVolumeNegativeTest-1889965975</nova:project>
Jul 27 12:55:53 user nova-compute[70994]:       </nova:owner>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:55:53 user nova-compute[70994]:       <nova:ports>
Jul 27 12:55:53 user nova-compute[70994]:         <nova:port uuid="240463f9-7ebb-4f8e-a570-4089967326f2">
Jul 27 12:55:53 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 12:55:53 user nova-compute[70994]:         </nova:port>
Jul 27 12:55:53 user nova-compute[70994]:       </nova:ports>
Jul 27 12:55:53 user nova-compute[70994]:     </nova:instance>
Jul 27 12:55:53 user nova-compute[70994]:   </metadata>
Jul 27 12:55:53 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:55:53 user nova-compute[70994]:     <system>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="serial">1972c076-947c-4b1e-96bd-098922378366</entry>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="uuid">1972c076-947c-4b1e-96bd-098922378366</entry>
Jul 27 12:55:53 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:55:53 user nova-compute[70994]:     </system>
Jul 27 12:55:53 user nova-compute[70994]:   </sysinfo>
Jul 27 12:55:53 user nova-compute[70994]:   <os>
Jul 27 12:55:53 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:55:53 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:55:53 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:55:53 user nova-compute[70994]:   </os>
Jul 27 12:55:53 user nova-compute[70994]:   <features>
Jul 27 12:55:53 user nova-compute[70994]:     <acpi/>
Jul 27 12:55:53 user nova-compute[70994]:     <apic/>
Jul 27 12:55:53 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:55:53 user nova-compute[70994]:   </features>
Jul 27 12:55:53 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:55:53 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:55:53 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:55:53 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:55:53 user nova-compute[70994]:   </clock>
Jul 27 12:55:53 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:55:53 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:55:53 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:55:53 user nova-compute[70994]:   </cpu>
Jul 27 12:55:53 user nova-compute[70994]:   <devices>
Jul 27 12:55:53 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:55:53 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:55:53 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk"/>
Jul 27 12:55:53 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:55:53 user nova-compute[70994]:     </disk>
Jul 27 12:55:53 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:55:53 user nova-compute[70994]:       <mac address="fa:16:3e:37:f1:93"/>
Jul 27 12:55:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:53 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:55:53 user nova-compute[70994]:       <target dev="tap240463f9-7e"/>
Jul 27 12:55:53 user nova-compute[70994]:     </interface>
Jul 27 12:55:53 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:55:53 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/console.log" append="off"/>
Jul 27 12:55:53 user nova-compute[70994]:     </serial>
Jul 27 12:55:53 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:55:53 user nova-compute[70994]:     <video>
Jul 27 12:55:53 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:55:53 user nova-compute[70994]:     </video>
Jul 27 12:55:53 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:55:53 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:55:53 user nova-compute[70994]:     </rng>
Jul 27 12:55:53 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:55:53 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:55:53 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:55:53 user nova-compute[70994]:     </memballoon>
Jul 27 12:55:53 user nova-compute[70994]:   </devices>
Jul 27 12:55:53 user nova-compute[70994]: </domain>
Jul 27 12:55:53 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1731753672',display_name='tempest-AttachVolumeNegativeTest-server-1731753672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1731753672',id=34,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJBlgt6DJVlBcHlvkIQb2eZHo70vGVXPtZv5zzBV/yIE5IqFPADak6S8M3gEdrh1j+stg/IhLruKUsPfacZPMDzNzF951ETAVdPW5zdCAW/RyiBNPAxRIyoFYVEcD4hdg==',key_name='tempest-keypair-1463066970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-c0ri608c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=1972c076-947c-4b1e-96bd-098922378366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG os_vif [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap240463f9-7e, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap240463f9-7e, col_values=(('external_ids', {'iface-id': '240463f9-7ebb-4f8e-a570-4089967326f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:f1:93', 'vm-uuid': '1972c076-947c-4b1e-96bd-098922378366'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:53 user nova-compute[70994]: INFO os_vif [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e')
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:37:f1:93, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updated VIF entry in instance network info cache for port 240463f9-7ebb-4f8e-a570-4089967326f2. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG nova.network.neutron [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updating instance_info_cache with network_info: [{"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:55:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-6b860642-5f1c-47b6-82f8-300cf7ce35f6 req-b6c1791e-c361-4f29-a6c8-adfde41c4dc0 service nova] Releasing lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:55:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] No waiting events found dispatching network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:55 user nova-compute[70994]: WARNING nova.compute.manager [req-2a8369ec-1459-456d-81f3-1e87fb8fdc0a req-e9440ed4-2f9b-43fc-9189-52cd045016ba service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received unexpected event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 for instance with vm_state building and task_state spawning.
Jul 27 12:55:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462557.0192266, 1972c076-947c-4b1e-96bd-098922378366 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] VM Resumed (Lifecycle Event)
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] Instance spawned successfully.
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462557.0220172, 1972c076-947c-4b1e-96bd-098922378366 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] VM Started (Lifecycle Event)
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] No waiting events found dispatching network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:55:57 user nova-compute[70994]: WARNING nova.compute.manager [req-9cca7bc6-02ab-4a69-82bb-7ff656b51ade req-c919ebb8-3ac9-4112-83e0-8a490bfbf2fb service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received unexpected event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 for instance with vm_state building and task_state spawning.
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Took 6.32 seconds to spawn the instance on the hypervisor.
Jul 27 12:55:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:55:57 user nova-compute[70994]: INFO nova.compute.manager [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Took 7.51 seconds to build instance.
Jul 27 12:55:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-12da8dda-9117-4483-a7e1-f3a4c29b0c3a tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.687s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:55:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:55:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:04 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462549.0120027, 7ae0f3cc-df1c-4427-9ab7-c7f0171de791 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:04 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] VM Stopped (Lifecycle Event)
Jul 27 12:56:04 user nova-compute[70994]: DEBUG nova.compute.manager [None req-9264dad3-371c-4d77-97f1-a979f557deea None None] [instance: 7ae0f3cc-df1c-4427-9ab7-c7f0171de791] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:56:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:11 user nova-compute[70994]: INFO nova.compute.manager [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Unrescuing
Jul 27 12:56:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquired lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:56:11 user nova-compute[70994]: DEBUG nova.network.neutron [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating instance_info_cache with network_info: [{"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Releasing lock "refresh_cache-63c995b0-7c07-4651-9aff-de708915f027" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'flavor' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG nova.compute.manager [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:12 user nova-compute[70994]: WARNING nova.compute.manager [req-d61cf7ab-2bbe-4744-8007-8dc1849ee555 req-d4c0a307-5ae9-4623-b58d-098872dc488f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:12 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance destroyed successfully.
Jul 27 12:56:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:14 user nova-compute[70994]: WARNING nova.compute.manager [req-144a0cf6-7b90-4b5b-956e-b2481f1d1362 req-5fa82fa6-6153-4039-9f8e-cd00589bd09c service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:15 user nova-compute[70994]: INFO nova.compute.manager [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Terminating instance
Jul 27 12:56:15 user nova-compute[70994]: DEBUG nova.compute.manager [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-4193afab-ea7a-429a-a9dc-faf37feb1582 req-01818cf5-d344-4c8d-8f7b-162a5b0f9acd service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-unplugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:16 user nova-compute[70994]: WARNING nova.compute.manager [req-d765703d-b5a2-4e3d-a731-e6139240916d req-91b8668a-eee1-4ae9-8c24-450f0ba560be service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state rescued and task_state unrescuing.
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Instance destroyed successfully.
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.objects.instance [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lazy-loading 'resources' on Instance uuid 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-236902550',display_name='tempest-ServerRescueNegativeTestJSON-server-236902550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-236902550',id=1,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:44:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd7fc676a5924df880ae87b91900fab4',ramdisk_id='',reservation_id='r-mhva2p0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1795052237',owner_user_name='tempest-ServerRescueNegativeTestJSON-1795052237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:45:53Z,user_data=None,user_id='10d2b3b0a6c14b74a73370fda30251f7',uuid=9a42d4ce-c56b-4ad3-a1b5-61de584a48a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converting VIF {"id": "16971332-b334-4a2d-99a6-2336809450e6", "address": "fa:16:3e:00:43:57", "network": {"id": "ddf5201f-626a-43cc-b3e7-d72d6137b33c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1593370736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd7fc676a5924df880ae87b91900fab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16971332-b3", "ovs_interfaceid": "16971332-b334-4a2d-99a6-2336809450e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG os_vif [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16971332-b3, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:56:16 user nova-compute[70994]: INFO os_vif [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:43:57,bridge_name='br-int',has_traffic_filtering=True,id=16971332-b334-4a2d-99a6-2336809450e6,network=Network(ddf5201f-626a-43cc-b3e7-d72d6137b33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16971332-b3')
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Deleting instance files /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7_del
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Deletion of /opt/stack/data/nova/instances/9a42d4ce-c56b-4ad3-a1b5-61de584a48a7_del complete
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-85363b07-a22b-4d01-8299-3f4d5fd1797e tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Removed pending event for 63c995b0-7c07-4651-9aff-de708915f027 due to event {{(pid=70994) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462576.5911744, 63c995b0-7c07-4651-9aff-de708915f027 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Resumed (Lifecycle Event)
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462576.591643, 63c995b0-7c07-4651-9aff-de708915f027 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Started (Lifecycle Event)
Jul 27 12:56:16 user nova-compute[70994]: INFO nova.compute.manager [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 27 12:56:16 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:56:17 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:17 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Took 0.58 seconds to deallocate network for instance.
Jul 27 12:56:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:17 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:56:17 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:56:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:17 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Deleted allocations for instance 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7
Jul 27 12:56:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-040c43cf-82ed-4bde-a424-a7e3024777a6 tempest-ServerRescueNegativeTestJSON-1795052237 tempest-ServerRescueNegativeTestJSON-1795052237-project-member] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] Acquiring lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] Lock "9a42d4ce-c56b-4ad3-a1b5-61de584a48a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] No waiting events found dispatching network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:18 user nova-compute[70994]: WARNING nova.compute.manager [req-301b86bf-9030-4e78-a21e-6bbbdef2a0ee req-fa1b973b-16c7-4d4e-bb8e-dcab82568f0a service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received unexpected event network-vif-plugged-16971332-b334-4a2d-99a6-2336809450e6 for instance with vm_state deleted and task_state None.
Jul 27 12:56:18 user nova-compute[70994]: DEBUG nova.compute.manager [req-adb26788-d38c-48dc-9a75-1e31ebb82f9e req-555054ad-4aef-49a1-9468-91dde66ff282 service nova] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Received event network-vif-deleted-16971332-b334-4a2d-99a6-2336809450e6 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:56:19 user nova-compute[70994]: INFO nova.compute.claims [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Claim successful on node user
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:56:19 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.policy [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db8e13665d53464d9e601434a0cbce1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4488876cea8e410c9822a55b04cffc8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:56:19 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Creating image(s)
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "/opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "/opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:19 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk 1073741824" returned: 0 in 0.070s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Successfully created port: ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Cannot resize image /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'migration_context' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Ensure instance console log exists: /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Successfully updated port: ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquired lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-changed-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.compute.manager [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Refreshing instance network info cache due to event network-changed-ac6efe9e-c805-46d6-869c-67602dc3400d. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] Acquiring lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.neutron [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating instance_info_cache with network_info: [{"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Releasing lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Instance network_info: |[{"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] Acquired lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.neutron [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Refreshing network info cache for port ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Start _get_guest_xml network_info=[{"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:56:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:21 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1104644606',display_name='tempest-VolumesSnapshotTestJSON-instance-1104644606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1104644606',id=35,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPeJPHQK9Sh6DRzqENmZtx3qjEjOhLeLVIkUWlXAxQzVyDiMgQuic5fioQar947hqgPq0Y6pTR9krmPhmhEkf1Bet7PKACSi9bYUnlI/UWi35BuNCPJvw0I/WJobf9HRg==',key_name='tempest-keypair-321677142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-ryo046it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:56:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=f8484a0e-283c-4da4-98f3-788038c26d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'pci_devices' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:56:21 user nova-compute[70994]:   <uuid>f8484a0e-283c-4da4-98f3-788038c26d2b</uuid>
Jul 27 12:56:21 user nova-compute[70994]:   <name>instance-00000023</name>
Jul 27 12:56:21 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:56:21 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:56:21 user nova-compute[70994]:   <metadata>
Jul 27 12:56:21 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:56:21 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1104644606</nova:name>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:56:21</nova:creationTime>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:56:21 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:56:21 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:owner>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:user uuid="db8e13665d53464d9e601434a0cbce1d">tempest-VolumesSnapshotTestJSON-472536409-project-member</nova:user>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:project uuid="4488876cea8e410c9822a55b04cffc8c">tempest-VolumesSnapshotTestJSON-472536409</nova:project>
Jul 27 12:56:21 user nova-compute[70994]:       </nova:owner>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:56:21 user nova-compute[70994]:       <nova:ports>
Jul 27 12:56:21 user nova-compute[70994]:         <nova:port uuid="ac6efe9e-c805-46d6-869c-67602dc3400d">
Jul 27 12:56:21 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 12:56:21 user nova-compute[70994]:         </nova:port>
Jul 27 12:56:21 user nova-compute[70994]:       </nova:ports>
Jul 27 12:56:21 user nova-compute[70994]:     </nova:instance>
Jul 27 12:56:21 user nova-compute[70994]:   </metadata>
Jul 27 12:56:21 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:56:21 user nova-compute[70994]:     <system>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="serial">f8484a0e-283c-4da4-98f3-788038c26d2b</entry>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="uuid">f8484a0e-283c-4da4-98f3-788038c26d2b</entry>
Jul 27 12:56:21 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:56:21 user nova-compute[70994]:     </system>
Jul 27 12:56:21 user nova-compute[70994]:   </sysinfo>
Jul 27 12:56:21 user nova-compute[70994]:   <os>
Jul 27 12:56:21 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:56:21 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:56:21 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:56:21 user nova-compute[70994]:   </os>
Jul 27 12:56:21 user nova-compute[70994]:   <features>
Jul 27 12:56:21 user nova-compute[70994]:     <acpi/>
Jul 27 12:56:21 user nova-compute[70994]:     <apic/>
Jul 27 12:56:21 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:56:21 user nova-compute[70994]:   </features>
Jul 27 12:56:21 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:56:21 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:56:21 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:56:21 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:56:21 user nova-compute[70994]:   </clock>
Jul 27 12:56:21 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:56:21 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:56:21 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:56:21 user nova-compute[70994]:   </cpu>
Jul 27 12:56:21 user nova-compute[70994]:   <devices>
Jul 27 12:56:21 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:56:21 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:56:21 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk"/>
Jul 27 12:56:21 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:56:21 user nova-compute[70994]:     </disk>
Jul 27 12:56:21 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:56:21 user nova-compute[70994]:       <mac address="fa:16:3e:14:76:4a"/>
Jul 27 12:56:21 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:56:21 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:56:21 user nova-compute[70994]:       <target dev="tapac6efe9e-c8"/>
Jul 27 12:56:21 user nova-compute[70994]:     </interface>
Jul 27 12:56:21 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:56:21 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/console.log" append="off"/>
Jul 27 12:56:21 user nova-compute[70994]:     </serial>
Jul 27 12:56:21 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:56:21 user nova-compute[70994]:     <video>
Jul 27 12:56:21 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:56:21 user nova-compute[70994]:     </video>
Jul 27 12:56:21 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:56:21 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:56:21 user nova-compute[70994]:     </rng>
Jul 27 12:56:21 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:56:21 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:56:21 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:56:21 user nova-compute[70994]:     </memballoon>
Jul 27 12:56:21 user nova-compute[70994]:   </devices>
Jul 27 12:56:21 user nova-compute[70994]: </domain>
Jul 27 12:56:21 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1104644606',display_name='tempest-VolumesSnapshotTestJSON-instance-1104644606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1104644606',id=35,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPeJPHQK9Sh6DRzqENmZtx3qjEjOhLeLVIkUWlXAxQzVyDiMgQuic5fioQar947hqgPq0Y6pTR9krmPhmhEkf1Bet7PKACSi9bYUnlI/UWi35BuNCPJvw0I/WJobf9HRg==',key_name='tempest-keypair-321677142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-ryo046it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:56:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=f8484a0e-283c-4da4-98f3-788038c26d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG os_vif [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac6efe9e-c8, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac6efe9e-c8, col_values=(('external_ids', {'iface-id': 'ac6efe9e-c805-46d6-869c-67602dc3400d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:76:4a', 'vm-uuid': 'f8484a0e-283c-4da4-98f3-788038c26d2b'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:56:21 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:21 user nova-compute[70994]: INFO os_vif [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8')
Jul 27 12:56:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:56:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No VIF found with MAC fa:16:3e:14:76:4a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:56:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updated VIF entry in instance network info cache for port ac6efe9e-c805-46d6-869c-67602dc3400d. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:56:22 user nova-compute[70994]: DEBUG nova.network.neutron [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating instance_info_cache with network_info: [{"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-c5063eb3-d08a-45b4-8bfb-21ea6d058988 req-898e2205-7dde-436f-9254-392791c7c039 service nova] Releasing lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG nova.compute.manager [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:23 user nova-compute[70994]: WARNING nova.compute.manager [req-ad469911-2381-412d-a42d-dddf8640bde1 req-07f45d7d-92a6-4918-aed1-1c3916b99087 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state building and task_state spawning.
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462585.4544845, f8484a0e-283c-4da4-98f3-788038c26d2b => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] VM Resumed (Lifecycle Event)
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Instance spawned successfully.
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462585.4547355, f8484a0e-283c-4da4-98f3-788038c26d2b => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] VM Started (Lifecycle Event)
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:25 user nova-compute[70994]: INFO nova.compute.manager [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Took 6.41 seconds to build instance.
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:25 user nova-compute[70994]: DEBUG nova.compute.manager [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:25 user nova-compute[70994]: WARNING nova.compute.manager [req-5aa10a9f-257b-4e55-8c2d-6d6bbcc608e8 req-27d110ca-2927-4a41-bfa7-84b3e2b1ebef service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state active and task_state None.
Jul 27 12:56:25 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a60002fc-851e-4691-8988-7c5a62e1681c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.523s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:26 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:31 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462576.5135982, 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:56:31 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] VM Stopped (Lifecycle Event)
Jul 27 12:56:31 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e43189d5-bfab-435c-b3a5-de4a5ccbfc9d None None] [instance: 9a42d4ce-c56b-4ad3-a1b5-61de584a48a7] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:56:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [{"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:56:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:41 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:42 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:56:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:44 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7646MB free_disk=25.179855346679688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1972c076-947c-4b1e-96bd-098922378366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f8484a0e-283c-4da4-98f3-788038c26d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:56:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:56:45 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:56:45 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:56:45 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:56:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:46 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:47 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:49 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:56:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:56:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:51 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:56:54 user nova-compute[70994]: INFO nova.compute.claims [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Claim successful on node user
Jul 27 12:56:54 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:54 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:56:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.policy [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8579c4a72d0c4f44b1bf1fd4215ec006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b20a41397014d77b288cc6a2a97ea39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:56:55 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Creating image(s)
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "/opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "/opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "/opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.139s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.140s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk 1073741824" returned: 0 in 0.058s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Successfully created port: c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Cannot resize image /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.objects.instance [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lazy-loading 'migration_context' on Instance uuid 798b2c91-4c2f-4906-befb-c3a14e2c4efa {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Ensure instance console log exists: /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Successfully updated port: c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquired lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-changed-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.compute.manager [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Refreshing instance network info cache due to event network-changed-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] Acquiring lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:56 user nova-compute[70994]: DEBUG nova.network.neutron [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updating instance_info_cache with network_info: [{"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Releasing lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Instance network_info: |[{"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] Acquired lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.neutron [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Refreshing network info cache for port c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Start _get_guest_xml network_info=[{"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:56:57 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:57 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986302401',display_name='tempest-AttachVolumeTestJSON-server-986302401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986302401',id=36,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4Yi2La0hONw/xfAHQqRNz3s8VAHGTvnbBZgP79YVcr4prx+Oqtu5oEe3n3/mpp2cc8AdlBniokSpPAGkR5qSNiP+RPgIIru/1mrpl3nWHkxBV9CcZfNSWN6yD8YP5XQ==',key_name='tempest-keypair-1842588554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b20a41397014d77b288cc6a2a97ea39',ramdisk_id='',reservation_id='r-qr9tmieh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2073980352',owner_user_name='tempest-AttachVolumeTestJSON-2073980352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8579c4a72d0c4f44b1bf1fd4215ec006',uuid=798b2c91-4c2f-4906-befb-c3a14e2c4efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Converting VIF {"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:8d,bridge_name='br-int',has_traffic_filtering=True,id=c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b,network=Network(6874216c-9068-413f-b901-c604061a9d89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d38f1f-72') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.objects.instance [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lazy-loading 'pci_devices' on Instance uuid 798b2c91-4c2f-4906-befb-c3a14e2c4efa {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:56:57 user nova-compute[70994]:   <uuid>798b2c91-4c2f-4906-befb-c3a14e2c4efa</uuid>
Jul 27 12:56:57 user nova-compute[70994]:   <name>instance-00000024</name>
Jul 27 12:56:57 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:56:57 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:56:57 user nova-compute[70994]:   <metadata>
Jul 27 12:56:57 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:56:57 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeTestJSON-server-986302401</nova:name>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:56:57</nova:creationTime>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:56:57 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:56:57 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:owner>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:user uuid="8579c4a72d0c4f44b1bf1fd4215ec006">tempest-AttachVolumeTestJSON-2073980352-project-member</nova:user>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:project uuid="6b20a41397014d77b288cc6a2a97ea39">tempest-AttachVolumeTestJSON-2073980352</nova:project>
Jul 27 12:56:57 user nova-compute[70994]:       </nova:owner>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:56:57 user nova-compute[70994]:       <nova:ports>
Jul 27 12:56:57 user nova-compute[70994]:         <nova:port uuid="c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b">
Jul 27 12:56:57 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 12:56:57 user nova-compute[70994]:         </nova:port>
Jul 27 12:56:57 user nova-compute[70994]:       </nova:ports>
Jul 27 12:56:57 user nova-compute[70994]:     </nova:instance>
Jul 27 12:56:57 user nova-compute[70994]:   </metadata>
Jul 27 12:56:57 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:56:57 user nova-compute[70994]:     <system>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="serial">798b2c91-4c2f-4906-befb-c3a14e2c4efa</entry>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="uuid">798b2c91-4c2f-4906-befb-c3a14e2c4efa</entry>
Jul 27 12:56:57 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:56:57 user nova-compute[70994]:     </system>
Jul 27 12:56:57 user nova-compute[70994]:   </sysinfo>
Jul 27 12:56:57 user nova-compute[70994]:   <os>
Jul 27 12:56:57 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:56:57 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:56:57 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:56:57 user nova-compute[70994]:   </os>
Jul 27 12:56:57 user nova-compute[70994]:   <features>
Jul 27 12:56:57 user nova-compute[70994]:     <acpi/>
Jul 27 12:56:57 user nova-compute[70994]:     <apic/>
Jul 27 12:56:57 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:56:57 user nova-compute[70994]:   </features>
Jul 27 12:56:57 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:56:57 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:56:57 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:56:57 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:56:57 user nova-compute[70994]:   </clock>
Jul 27 12:56:57 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:56:57 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:56:57 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:56:57 user nova-compute[70994]:   </cpu>
Jul 27 12:56:57 user nova-compute[70994]:   <devices>
Jul 27 12:56:57 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:56:57 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:56:57 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk"/>
Jul 27 12:56:57 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:56:57 user nova-compute[70994]:     </disk>
Jul 27 12:56:57 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:56:57 user nova-compute[70994]:       <mac address="fa:16:3e:51:bc:8d"/>
Jul 27 12:56:57 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:56:57 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:56:57 user nova-compute[70994]:       <target dev="tapc7d38f1f-72"/>
Jul 27 12:56:57 user nova-compute[70994]:     </interface>
Jul 27 12:56:57 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:56:57 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/console.log" append="off"/>
Jul 27 12:56:57 user nova-compute[70994]:     </serial>
Jul 27 12:56:57 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:56:57 user nova-compute[70994]:     <video>
Jul 27 12:56:57 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:56:57 user nova-compute[70994]:     </video>
Jul 27 12:56:57 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:56:57 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:56:57 user nova-compute[70994]:     </rng>
Jul 27 12:56:57 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:56:57 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:56:57 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:56:57 user nova-compute[70994]:     </memballoon>
Jul 27 12:56:57 user nova-compute[70994]:   </devices>
Jul 27 12:56:57 user nova-compute[70994]: </domain>
Jul 27 12:56:57 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-986302401',display_name='tempest-AttachVolumeTestJSON-server-986302401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-986302401',id=36,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4Yi2La0hONw/xfAHQqRNz3s8VAHGTvnbBZgP79YVcr4prx+Oqtu5oEe3n3/mpp2cc8AdlBniokSpPAGkR5qSNiP+RPgIIru/1mrpl3nWHkxBV9CcZfNSWN6yD8YP5XQ==',key_name='tempest-keypair-1842588554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b20a41397014d77b288cc6a2a97ea39',ramdisk_id='',reservation_id='r-qr9tmieh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2073980352',owner_user_name='tempest-AttachVolumeTestJSON-2073980352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8579c4a72d0c4f44b1bf1fd4215ec006',uuid=798b2c91-4c2f-4906-befb-c3a14e2c4efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Converting VIF {"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:8d,bridge_name='br-int',has_traffic_filtering=True,id=c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b,network=Network(6874216c-9068-413f-b901-c604061a9d89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d38f1f-72') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG os_vif [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:8d,bridge_name='br-int',has_traffic_filtering=True,id=c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b,network=Network(6874216c-9068-413f-b901-c604061a9d89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d38f1f-72') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7d38f1f-72, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7d38f1f-72, col_values=(('external_ids', {'iface-id': 'c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:bc:8d', 'vm-uuid': '798b2c91-4c2f-4906-befb-c3a14e2c4efa'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:57 user nova-compute[70994]: INFO os_vif [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:8d,bridge_name='br-int',has_traffic_filtering=True,id=c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b,network=Network(6874216c-9068-413f-b901-c604061a9d89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d38f1f-72')
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] No VIF found with MAC fa:16:3e:51:bc:8d, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.neutron [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updated VIF entry in instance network info cache for port c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG nova.network.neutron [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updating instance_info_cache with network_info: [{"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:56:57 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-afcae087-215e-47a4-88a0-567d33516176 req-70a08de8-e088-499e-9b9f-2918114575f1 service nova] Releasing lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:56:58 user nova-compute[70994]: DEBUG nova.compute.manager [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:56:58 user nova-compute[70994]: WARNING nova.compute.manager [req-fcf02990-3cd7-49c7-9d18-e1a363648d3a req-83c45218-b3c7-4d18-9902-19f7fec44184 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state building and task_state spawning.
Jul 27 12:56:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:56:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:57:00 user nova-compute[70994]: WARNING nova.compute.manager [req-18df4d7c-034c-4b65-91ba-414048783512 req-85a5405b-5d37-4c66-994b-c50249504c69 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state building and task_state spawning.
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462620.8213286, 798b2c91-4c2f-4906-befb-c3a14e2c4efa => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] VM Resumed (Lifecycle Event)
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Instance spawned successfully.
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462620.822871, 798b2c91-4c2f-4906-befb-c3a14e2c4efa => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] VM Started (Lifecycle Event)
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:57:00 user nova-compute[70994]: INFO nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Took 5.73 seconds to spawn the instance on the hypervisor.
Jul 27 12:57:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:57:01 user nova-compute[70994]: INFO nova.compute.manager [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Took 6.49 seconds to build instance.
Jul 27 12:57:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-67625d00-1438-4898-9284-c7ac7efcef48 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.607s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-changed-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG nova.compute.manager [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Refreshing instance network info cache due to event network-changed-95d8eb07-381d-4f1b-84d2-c5025edaebfc. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] Acquiring lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] Acquired lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:57:07 user nova-compute[70994]: DEBUG nova.network.neutron [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Refreshing network info cache for port 95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG nova.objects.instance [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:08 user nova-compute[70994]: INFO nova.compute.manager [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attaching volume b99867ed-76c5-4c1d-ae1a-b0ac05a87996 to /dev/vdb
Jul 27 12:57:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updated VIF entry in instance network info cache for port 95d8eb07-381d-4f1b-84d2-c5025edaebfc. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG nova.network.neutron [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating instance_info_cache with network_info: [{"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7d309f78-9807-4b90-9929-1e9acd6b89f8 req-1fe62010-b91f-4e4f-8910-c66b57f32644 service nova] Releasing lock "refresh_cache-f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9291e-664b-44dc-8415-7d09841d9537]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab8bf7-b95a-4463-b79f-eb5c8a3b4658]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e83788-dc73-415a-be81-84c56f3c3c9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa187b-6856-4f33-88a2-539448fd5f34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:08 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:57:08 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c55124-6732-453b-bc60-3d2497459a81]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG os_brick.utils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:08 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating existing volume attachment record: 6d016f77-99d0-4f8f-abd8-3cb75625ded8 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing instance network info cache due to event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG nova.network.neutron [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:57:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updated VIF entry in instance network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f8a5721c-997a-4ffa-a312-5f64a3057e7a req-dbab1dcd-0040-42b8-9474-ef89cbfd2b68 service nova] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:10 user nova-compute[70994]: INFO nova.compute.manager [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Detaching volume 358b1236-d481-4d83-b1cd-5109ba9b808b
Jul 27 12:57:10 user nova-compute[70994]: INFO nova.virt.block_device [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Attempting to driver detach volume 358b1236-d481-4d83-b1cd-5109ba9b808b from mountpoint /dev/vdb
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Attempting to detach device vdb from instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:10 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:10 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:57:10 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:10 user nova-compute[70994]:   <serial>358b1236-d481-4d83-b1cd-5109ba9b808b</serial>
Jul 27 12:57:10 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:57:10 user nova-compute[70994]: </disk>
Jul 27 12:57:10 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:10 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully detached device vdb from instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 from the persistent domain config.
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:57:10 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:10 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:10 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:57:10 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:10 user nova-compute[70994]:   <serial>358b1236-d481-4d83-b1cd-5109ba9b808b</serial>
Jul 27 12:57:10 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 12:57:10 user nova-compute[70994]: </disk>
Jul 27 12:57:10 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462631.2496724, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:57:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully detached device vdb from instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 from the live domain config.
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzMmlbWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:11 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fab5b9f-3bb1-4e5d-834e-41e491390fa9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:57:11 user nova-compute[70994]: No targets found.
Jul 27 12:57:11 user nova-compute[70994]: iSNS:
Jul 27 12:57:11 user nova-compute[70994]: No targets found.
Jul 27 12:57:11 user nova-compute[70994]: STATIC:
Jul 27 12:57:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:57:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b
Jul 27 12:57:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:11 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:57:11 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:11 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:11 user nova-compute[70994]: FIRMWARE:
Jul 27 12:57:11 user nova-compute[70994]: No targets found.
Jul 27 12:57:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:57:11 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:57:11 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cf8939-4b9d-4c60-be63-1223783038e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a9f4fa-d770-4dbe-ad62-0d53cc22949c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:11 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:11 user nova-compute[70994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:57:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:11 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:11 user nova-compute[70994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b (non-flash)
Jul 27 12:57:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4315000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a47588-fae4-459c-940a-450d31003e80]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.compute.manager [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing instance network info cache due to event network-changed-8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] Acquiring lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] Acquired lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Refreshing network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35101a6-9c4a-4bea-acb6-fb3b6da56049]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[84873698-560a-44f7-abf2-6a9b316d6766]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[33313555-17ff-44c1-89d4-f0a4644b8224]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f30b479-59d8-415a-bf65-79dbd22a9537]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96707c0b-64f3-4f20-87fd-3d1ebe381283]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260]
Jul 27 12:57:11 user nova-compute[70994]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:11 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358b1236-d481-4d83-b1cd-5109ba9b808b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c8ee7-2808-4fb0-9794-4a9c475af596]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] <== disconnect_volume: return (350ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updated VIF entry in instance network info cache for port 8631dbc1-a0ad-4dc2-9734-094dc6fb5139. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [{"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:57:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-4cf5572e-3e05-48c5-9f9d-5a2ac7f2f3b5 req-9e2c0ca4-6b6e-4eed-9cde-382b5d457614 service nova] Releasing lock "refresh_cache-3ae811b1-0975-42e0-82ab-be09c2c2ec11" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:57:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:12 user nova-compute[70994]: DEBUG nova.objects.instance [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'flavor' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-bd65ef79-4a61-4cb2-aaac-5c896018ddc3 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:15 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:57:15 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epfoXGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:16 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:16 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:16 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fbbb2d-b7c0-4c13-9f25-426a51ab19ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:57:16 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f8c763-4159-47a9-843b-4aa264b0b50c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996] added
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fefa8d-8a42-4f1a-a498-92bb0c1ccd3f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[faadf843-9752-4707-a80d-ba16264723be]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epfoXGTz {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epfoXGTz" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59849974-b01f-4146-98c8-e240e6cf7e24]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epfoXGTz'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[363f950c-3c63-4f4a-9716-5f7476c09295]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eed39c-fa34-437f-9bda-46475629ff69]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a94be11-4984-4fb6-83bb-5074632ddadf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260]
Jul 27 12:57:16 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2fdd52-93ef-405f-a876-fd84e4272144]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e812bc96-f206-48b5-8211-4d9eace3ca3f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:16 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:16 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a3ed1-4e5f-4ebc-9976-6ea6ab16a0ac]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:57:16 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epfoXGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23738636665613862', 'path': '/dev/sdd'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738636665613862', 'path': '/dev/sdd'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.objects.instance [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:57:17 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:17 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:57:17 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:17 user nova-compute[70994]:   <serial>b99867ed-76c5-4c1d-ae1a-b0ac05a87996</serial>
Jul 27 12:57:17 user nova-compute[70994]: </disk>
Jul 27 12:57:17 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No VIF found with MAC fa:16:3e:c2:52:50, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:57:17 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-cc127258-482b-48f2-8636-efefbc35c8f0 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.191s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG nova.objects.instance [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:21 user nova-compute[70994]: INFO nova.compute.manager [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attaching volume a1805279-f321-41f6-929f-759646428ff9 to /dev/vdc
Jul 27 12:57:21 user nova-compute[70994]: DEBUG os_brick.utils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec477b1-66e1-459b-9793-79e1af56b01a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a00ff-8199-49f5-8bfa-d0d97513afa0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae118da8-7554-4dc5-b527-b34b54f08bef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e142b6-2ef3-4fd8-8bb1-90a50ae01c3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:57:21 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:22 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:57:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65db0b-f1f0-4845-a8ce-d04c50261410]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG os_brick.utils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating existing volume attachment record: fc5fa423-28cc-4331-a07d-5fe7e08408ca {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:57:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSsexRqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:28 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:28 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:28 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bed5e1-3dd9-4437-9059-ae5361471881]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:57:28 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1faf2-141f-4f11-892f-bf1c3b2747c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9] added
Jul 27 12:57:28 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b99116c-0e72-4f1a-b015-56d270e8cdd7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd940fd-355a-479e-927a-c4f2b3e97111]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSsexRqu {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSsexRqu" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89c41a-c287-4961-809f-8d0c1f79dc4b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VSsexRqu'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[34185f4c-247f-4095-8b63-fcb851750943]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[823678b9-d77b-467d-a7e2-9d3e20e5a84b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:28 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:28 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:28 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:28 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:28 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:28 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:28 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15b126-5d41-4eb7-9a92-26f6a906dd17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260]
Jul 27 12:57:29 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:29 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf7321-389e-47bd-8284-e3fca755e9a7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84974f6-19f0-4559-8854-6a6fed57a1f5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)
Jul 27 12:57:29 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:29 user nova-compute[70994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)
Jul 27 12:57:29 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aa61b1-c8fb-43b9-9d64-53d78ce65961]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:29 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSsexRqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26461303932633331', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461303932633331', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.objects.instance [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:57:30 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:30 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:30 user nova-compute[70994]:   <target dev="vdc" bus="virtio"/>
Jul 27 12:57:30 user nova-compute[70994]:   <serial>a1805279-f321-41f6-929f-759646428ff9</serial>
Jul 27 12:57:30 user nova-compute[70994]: </disk>
Jul 27 12:57:30 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] No VIF found with MAC fa:16:3e:c2:52:50, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:57:30 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-130455d1-f843-48e8-8974-2435a5d70577 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.874s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:31 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:31 user nova-compute[70994]: INFO nova.compute.manager [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Detaching volume a1805279-f321-41f6-929f-759646428ff9
Jul 27 12:57:31 user nova-compute[70994]: INFO nova.virt.block_device [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attempting to driver detach volume a1805279-f321-41f6-929f-759646428ff9 from mountpoint /dev/vdc
Jul 27 12:57:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Attempting to detach device vdc from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:57:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:31 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:31 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:31 user nova-compute[70994]:   <target dev="vdc" bus="virtio"/>
Jul 27 12:57:31 user nova-compute[70994]:   <serial>a1805279-f321-41f6-929f-759646428ff9</serial>
Jul 27 12:57:31 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 12:57:31 user nova-compute[70994]: </disk>
Jul 27 12:57:31 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:31 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully detached device vdc from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the persistent domain config.
Jul 27 12:57:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:57:31 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:31 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:31 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:31 user nova-compute[70994]:   <target dev="vdc" bus="virtio"/>
Jul 27 12:57:31 user nova-compute[70994]:   <serial>a1805279-f321-41f6-929f-759646428ff9</serial>
Jul 27 12:57:31 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 12:57:31 user nova-compute[70994]: </disk>
Jul 27 12:57:31 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462652.343586, f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:57:32 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully detached device vdc from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the live domain config.
Jul 27 12:57:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSsexRqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:32 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6852eaf-6037-436b-a6f6-ba65b5282ca5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:57:32 user nova-compute[70994]: No targets found.
Jul 27 12:57:32 user nova-compute[70994]: iSNS:
Jul 27 12:57:32 user nova-compute[70994]: No targets found.
Jul 27 12:57:32 user nova-compute[70994]: STATIC:
Jul 27 12:57:32 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:57:32 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:32 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:32 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9
Jul 27 12:57:32 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:32 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:32 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996
Jul 27 12:57:32 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:32 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:32 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:57:32 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:32 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:32 user nova-compute[70994]: FIRMWARE:
Jul 27 12:57:32 user nova-compute[70994]: No targets found.
Jul 27 12:57:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:57:32 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:57:32 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d230e-5548-4ff1-b68a-bd997848313a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[769a7f74-a782-4df0-903a-af245dacb98f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)
Jul 27 12:57:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:32 user nova-compute[70994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 (non-flash)
Jul 27 12:57:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f420fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb363cc-f59d-49b4-bb30-8e6864659fb1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b8b50-210c-4922-84e1-0ef29c5129ac]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd60562-5f61-49e8-8acb-3725e43e5f11]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9fcd65-a32a-4700-991c-676d9ce04bba]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0413cb-a2bf-4365-9843-98d82aeb86ce]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a155baa-2b4f-4efd-bbd2-90880bf2e7a9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260]
Jul 27 12:57:32 user nova-compute[70994]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:32 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1805279-f321-41f6-929f-759646428ff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ae6c0d-7698-4b70-8dbc-89975be44bb5]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== disconnect_volume: return (293ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:32 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:57:33 user nova-compute[70994]: DEBUG nova.objects.instance [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:33 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-948a0dec-8f4d-4729-bca5-443027283089 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:57:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:39 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-changed-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Refreshing instance network info cache due to event network-changed-240463f9-7ebb-4f8e-a570-4089967326f2. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] Acquiring lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] Acquired lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.network.neutron [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Refreshing network info cache for port 240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.network.neutron [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updated VIF entry in instance network info cache for port 240463f9-7ebb-4f8e-a570-4089967326f2. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.network.neutron [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updating instance_info_cache with network_info: [{"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-7711fa6d-7b56-4072-98c9-ae42694df8fd req-57a869bd-9df7-4b80-b0ff-a46c1476a805 service nova] Releasing lock "refresh_cache-1972c076-947c-4b1e-96bd-098922378366" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [{"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-aa5113ca-9965-4138-af35-af69b50f9500" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:57:41 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:57:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG nova.objects.instance [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:43 user nova-compute[70994]: INFO nova.compute.manager [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Attaching volume 7f41bebf-b21f-49cf-a89a-6fda0dba81f0 to /dev/vdb
Jul 27 12:57:43 user nova-compute[70994]: DEBUG os_brick.utils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3aa001-c3a4-42b4-8095-152c253f9163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d311dd9-7f2a-4693-8022-80c2a6a27004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785fec5-17f1-46c2-822a-400c9cdbaa21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f0080-f2bb-4c7c-84e6-2075a2c194dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:57:44 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db085fbb-60e3-4d9d-a30a-513d940bf54e]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG os_brick.utils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updating existing volume attachment record: aa0d0cc9-2e8d-4c26-a0f4-2e3f3121d64b {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:44 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:57:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=25.120914459228516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 63c995b0-7c07-4651-9aff-de708915f027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1972c076-947c-4b1e-96bd-098922378366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f8484a0e-283c-4da4-98f3-788038c26d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 798b2c91-4c2f-4906-befb-c3a14e2c4efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:57:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:49 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOGLvZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:50 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:50 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:50 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[500533dc-a558-4a51-8a91-076a45415a27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:57:50 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b08063-d47e-45da-af47-ae0edc329e9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0] added
Jul 27 12:57:50 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab79c6e-18ae-4c18-9cc6-fcda3313c6fc]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2003c-2fb2-43bc-ab73-c748c7e5f511]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuOGLvZP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuOGLvZP" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f9f20-0809-4f99-915e-31d475603769]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuOGLvZP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab31db7-18cb-437e-9a2c-51dfb4ffcc6b]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff2a86-0b13-456a-b917-65cd0dd49329]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e02728-bd9e-40ec-82b5-2f661ee4776a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260]
Jul 27 12:57:51 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4569a13-9ccc-42e9-acb6-c0af52277462]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f76e27-5437-4cf6-a296-e3328e3c21c2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)
Jul 27 12:57:51 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b724385-9102-4b06-a7fc-bf8a83a1e1c3]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:51 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOGLvZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23463336636656136', 'path': '/dev/sde'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463336636656136', 'path': '/dev/sde'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.objects.instance [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:57:52 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:52 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:52 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:52 user nova-compute[70994]:   <serial>7f41bebf-b21f-49cf-a89a-6fda0dba81f0</serial>
Jul 27 12:57:52 user nova-compute[70994]: </disk>
Jul 27 12:57:52 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:37:f1:93, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:57:52 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-61a239f2-6f6c-4fd4-aaa8-586608151941 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.921s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:57:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:57:53 user nova-compute[70994]: INFO nova.compute.manager [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Detaching volume 7f41bebf-b21f-49cf-a89a-6fda0dba81f0
Jul 27 12:57:54 user nova-compute[70994]: INFO nova.virt.block_device [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Attempting to driver detach volume 7f41bebf-b21f-49cf-a89a-6fda0dba81f0 from mountpoint /dev/vdb
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Attempting to detach device vdb from instance 1972c076-947c-4b1e-96bd-098922378366 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:54 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:54 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:54 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:54 user nova-compute[70994]:   <serial>7f41bebf-b21f-49cf-a89a-6fda0dba81f0</serial>
Jul 27 12:57:54 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:57:54 user nova-compute[70994]: </disk>
Jul 27 12:57:54 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully detached device vdb from instance 1972c076-947c-4b1e-96bd-098922378366 from the persistent domain config.
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1972c076-947c-4b1e-96bd-098922378366 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:57:54 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:57:54 user nova-compute[70994]:   <source dev="/dev/sde"/>
Jul 27 12:57:54 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:57:54 user nova-compute[70994]:   <serial>7f41bebf-b21f-49cf-a89a-6fda0dba81f0</serial>
Jul 27 12:57:54 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:57:54 user nova-compute[70994]: </disk>
Jul 27 12:57:54 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462674.4432187, 1972c076-947c-4b1e-96bd-098922378366 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:57:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully detached device vdb from instance 1972c076-947c-4b1e-96bd-098922378366 from the live domain config.
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOGLvZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:57:54 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc66d5-c09a-41f8-ba61-c905630c7ae1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:57:54 user nova-compute[70994]: No targets found.
Jul 27 12:57:54 user nova-compute[70994]: iSNS:
Jul 27 12:57:54 user nova-compute[70994]: No targets found.
Jul 27 12:57:54 user nova-compute[70994]: STATIC:
Jul 27 12:57:54 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:57:54 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:54 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:54 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0
Jul 27 12:57:54 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:54 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:54 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996
Jul 27 12:57:54 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:54 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:54 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:57:54 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:57:54 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:57:54 user nova-compute[70994]: FIRMWARE:
Jul 27 12:57:54 user nova-compute[70994]: No targets found.
Jul 27 12:57:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:57:54 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:57:54 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da6069-b11c-455c-94ab-83ddb4c64265]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b5a7ab-4aba-4f4a-9b61-348c267371d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)
Jul 27 12:57:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:57:54 user nova-compute[70994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 (non-flash)
Jul 27 12:57:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4315090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0'): ({'sde'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Removing single pathed devices sde {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef43c57-3122-45e7-a323-ba72d0fe275c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a2e79f-8844-4fe1-8521-8b3ea2087a09]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flushing IO for device /dev/sde {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7606a196-cc34-4c53-b258-50378ec21a48]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a78073-89e5-4d9d-b80f-4996ed72d742]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] SCSI volumes sde have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637f841-5d42-463c-92ed-feccc7dd9330]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf934d70-ad2c-4b86-80bb-ca9b03ea634c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260]
Jul 27 12:57:54 user nova-compute[70994]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0, portal: 172.16.0.220,3260] successful.
Jul 27 12:57:54 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f41bebf-b21f-49cf-a89a-6fda0dba81f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b11e6b-4e79-4adf-9a34-908c284ab6b1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] <== disconnect_volume: return (291ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:57:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:57:55 user nova-compute[70994]: DEBUG nova.objects.instance [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'flavor' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:57:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-8d09844a-b3cc-4fd1-a4a2-d36f56e2bfd8 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.560s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:57:57 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:57:58 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:02 user nova-compute[70994]: INFO nova.compute.manager [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Terminating instance
Jul 27 12:58:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-d27e7ea3-fa11-45dd-9593-532880184740 req-7b5b70ac-1f28-449e-aba4-3d94fe77d14a service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-unplugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:02 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Instance destroyed successfully.
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.objects.instance [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid 63c995b0-7c07-4651-9aff-de708915f027 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1001634945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1001634945',id=30,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-hoop5re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:56:17Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=63c995b0-7c07-4651-9aff-de708915f027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "917035e3-4e6b-4783-905f-db9070bc02cf", "address": "fa:16:3e:00:04:a3", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917035e3-4e", "ovs_interfaceid": "917035e3-4e6b-4783-905f-db9070bc02cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_vif [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap917035e3-4e, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:03 user nova-compute[70994]: INFO os_vif [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=917035e3-4e6b-4783-905f-db9070bc02cf,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917035e3-4e')
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFXothwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:03 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6eee7-21b2-4471-baa3-7998933b2126]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:58:03 user nova-compute[70994]: No targets found.
Jul 27 12:58:03 user nova-compute[70994]: iSNS:
Jul 27 12:58:03 user nova-compute[70994]: No targets found.
Jul 27 12:58:03 user nova-compute[70994]: STATIC:
Jul 27 12:58:03 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde
Jul 27 12:58:03 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:03 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:03 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996
Jul 27 12:58:03 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:03 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:03 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:58:03 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:03 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:03 user nova-compute[70994]: FIRMWARE:
Jul 27 12:58:03 user nova-compute[70994]: No targets found.
Jul 27 12:58:03 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:58:03 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:58:03 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ba14e8-94c1-4c00-af71-32b204a46125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38e145-a46d-4f10-8022-a8d3c96903c7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:03 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:58:03 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:03 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:03 user nova-compute[70994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde (non-flash)
Jul 27 12:58:03 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:03 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f43a7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a36e1-8d72-4648-ad8e-c0a81eb72cd1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7148f96-1a68-43bd-ab6b-fd26973e4424]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971dffb-4398-4c08-bab5-30bb6b4bf3c8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6374cbf9-02b4-48db-9e34-492829183c78]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2f3eb8ee-07de73e61c2abbe6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2f3eb8ee', '/dev/disk/by-id/scsi-23037646537336536') {{(pid=82465) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83bd6af-d937-409f-81d7-d7416111d029]: (4, None) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b1cd1-73a2-49ff-857c-aaca9dc201e8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11a3f0-392c-4d91-a466-9e505e7e1874]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260]
Jul 27 12:58:03 user nova-compute[70994]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde, portal: 172.16.0.220,3260] successful.
Jul 27 12:58:03 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1e910-1997-43d0-a27d-166b0da33dde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[68abd7e6-660b-4b7f-91c7-3e1b771909a7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== disconnect_volume: return (386ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:58:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Deleting instance files /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027_del
Jul 27 12:58:03 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Deletion of /opt/stack/data/nova/instances/63c995b0-7c07-4651-9aff-de708915f027_del complete
Jul 27 12:58:03 user nova-compute[70994]: INFO nova.compute.manager [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 27 12:58:03 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:58:03 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:04 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Took 0.52 seconds to deallocate network for instance.
Jul 27 12:58:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-d7961a55-fd26-4072-adbf-4f19dff661f4 req-afe708fc-b904-43c7-88e6-b927ce94e073 service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-deleted-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] Acquiring lock "63c995b0-7c07-4651-9aff-de708915f027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] Lock "63c995b0-7c07-4651-9aff-de708915f027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:04 user nova-compute[70994]: DEBUG nova.compute.manager [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] No waiting events found dispatching network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:04 user nova-compute[70994]: WARNING nova.compute.manager [req-8b19bcc8-d7c6-4a04-ac98-dc80cc57daea req-d1e4e990-9f72-4432-9cb3-99dd39172c2f service nova] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Received unexpected event network-vif-plugged-917035e3-4e6b-4783-905f-db9070bc02cf for instance with vm_state active and task_state deleting.
Jul 27 12:58:04 user nova-compute[70994]: INFO nova.compute.manager [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Took 0.77 seconds to detach 1 volumes for instance.
Jul 27 12:58:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:05 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:05 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:05 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Deleted allocations for instance 63c995b0-7c07-4651-9aff-de708915f027
Jul 27 12:58:05 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-7d18cfad-357f-4349-97a2-5841bfd0c320 tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "63c995b0-7c07-4651-9aff-de708915f027" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.019s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:06 user nova-compute[70994]: INFO nova.compute.manager [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Terminating instance
Jul 27 12:58:06 user nova-compute[70994]: DEBUG nova.compute.manager [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-0f71ad6e-51fc-4bb0-bed9-a6a804a82fb1 req-254e7ede-0232-4bd4-aa6e-c2a7d34fc6ee service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-unplugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Instance destroyed successfully.
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.objects.instance [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'resources' on Instance uuid 3ae811b1-0975-42e0-82ab-be09c2c2ec11 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-519794403',display_name='tempest-TestMinimumBasicScenario-server-519794403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-519794403',id=32,image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI2xdaCM05SvMIpMZRxA06nyGUcLrkjm5ifUbqRcZOhJqMNulVV0ni61w7ynmbM8PVv4VoKVGWrmeHg9Fcz86mmh62jiOzk5IHP8/D2MxKJNKBdNyu2jg24UPUtEgwjUA==',key_name='tempest-TestMinimumBasicScenario-1303439005',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-iy5cn3r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93186396-f12e-4e28-a24d-9de7b7d114f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:55:25Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3ae811b1-0975-42e0-82ab-be09c2c2ec11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "address": "fa:16:3e:85:2e:6b", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8631dbc1-a0", "ovs_interfaceid": "8631dbc1-a0ad-4dc2-9734-094dc6fb5139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG os_vif [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8631dbc1-a0, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:07 user nova-compute[70994]: INFO os_vif [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:2e:6b,bridge_name='br-int',has_traffic_filtering=True,id=8631dbc1-a0ad-4dc2-9734-094dc6fb5139,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8631dbc1-a0')
Jul 27 12:58:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Deleting instance files /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11_del
Jul 27 12:58:07 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Deletion of /opt/stack/data/nova/instances/3ae811b1-0975-42e0-82ab-be09c2c2ec11_del complete
Jul 27 12:58:07 user nova-compute[70994]: INFO nova.compute.manager [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 27 12:58:07 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:58:07 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:58:08 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:08 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Took 0.55 seconds to deallocate network for instance.
Jul 27 12:58:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:08 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:08 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:08 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Deleted allocations for instance 3ae811b1-0975-42e0-82ab-be09c2c2ec11
Jul 27 12:58:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-2b9fcc13-a363-49e4-856e-47849867a9bd tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] Acquiring lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:09 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] Lock "3ae811b1-0975-42e0-82ab-be09c2c2ec11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] No waiting events found dispatching network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:09 user nova-compute[70994]: WARNING nova.compute.manager [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received unexpected event network-vif-plugged-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 for instance with vm_state deleted and task_state None.
Jul 27 12:58:09 user nova-compute[70994]: DEBUG nova.compute.manager [req-bfa5da27-85af-4135-a2f0-293f82e5f542 req-fac63437-61aa-48cf-aaa7-01da5dc60d79 service nova] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Received event network-vif-deleted-8631dbc1-a0ad-4dc2-9734-094dc6fb5139 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-changed-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:10 user nova-compute[70994]: DEBUG nova.compute.manager [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Refreshing instance network info cache due to event network-changed-ac6efe9e-c805-46d6-869c-67602dc3400d. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:58:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] Acquiring lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:58:10 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] Acquired lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:58:10 user nova-compute[70994]: DEBUG nova.network.neutron [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Refreshing network info cache for port ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG nova.objects.instance [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:11 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Ignoring supplied device name: /dev/vdb
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:11 user nova-compute[70994]: INFO nova.compute.manager [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Attaching volume 0385bd3d-c8d3-42da-bf00-de3a3e082ed2 to /dev/vdb
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.utils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updated VIF entry in instance network info cache for port ac6efe9e-c805-46d6-869c-67602dc3400d. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG nova.network.neutron [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating instance_info_cache with network_info: [{"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe90f9c-e768-49f7-8230-db5b035b6286]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-88f22902-7d01-4c2b-9693-e5003f2ebd04 req-04cf0276-5c9f-4f4c-bbb9-2982e93f301e service nova] Releasing lock "refresh_cache-f8484a0e-283c-4da4-98f3-788038c26d2b" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c1a51-18a3-4bd2-9726-ca5f1dca4101]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec75762-41db-4347-9c2d-f3fb2435252d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf81302-58e3-436f-ab0e-8b973dfd663d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:58:11 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:58:11 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbdd07d-abb1-4c7d-b33e-a7b5b521a29b]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG os_brick.utils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:11 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating existing volume attachment record: 03bd0584-67ab-4d54-84d7-03297aa724b5 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:58:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462683.1930056, 63c995b0-7c07-4651-9aff-de708915f027 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:58:18 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 63c995b0-7c07-4651-9aff-de708915f027] VM Stopped (Lifecycle Event)
Jul 27 12:58:18 user nova-compute[70994]: DEBUG nova.compute.manager [None req-31723e31-ded7-414a-baff-1232e042e884 None None] [instance: 63c995b0-7c07-4651-9aff-de708915f027] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPHcFrVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:18 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:18 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70ba168-1f30-4a37-b692-cca91c07aa8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:58:18 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f185640-5fca-41be-9ce5-771fcf463ece]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2] added
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f33c65-3c32-4f70-8633-b76df8efe8b7]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427d202-376a-4c1d-bbe0-54be26ece5b8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPHcFrVa {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPHcFrVa" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfcaa55-97c5-4f2b-9900-994d642c5312]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPHcFrVa'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1babb7e-0bf8-46f4-9b50-ada7f6cbe5ff]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23a36f-498f-4f60-b59e-2c4b7a282f23]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a934743-1cfd-499e-a533-11e3956c4bf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260]
Jul 27 12:58:18 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260] successful.
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57541c78-c770-4374-8c3c-80e8e8b12965]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29325c4f-c920-4b36-bbc8-5b0c674d05eb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:18 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2cbfb-16e1-4bef-be5c-9caa1c431ffe]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:58:18 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPHcFrVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26331336362356234', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331336362356234', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG nova.objects.instance [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:19 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:58:19 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:19 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:58:19 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:19 user nova-compute[70994]:   <serial>0385bd3d-c8d3-42da-bf00-de3a3e082ed2</serial>
Jul 27 12:58:19 user nova-compute[70994]: </disk>
Jul 27 12:58:19 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:58:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:58:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:58:20 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] No VIF found with MAC fa:16:3e:14:76:4a, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:58:20 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-58c4e6c8-8e9c-41c4-80c5-d07ba4678c0a tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.943s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:22 user nova-compute[70994]: INFO nova.compute.manager [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Detaching volume b99867ed-76c5-4c1d-ae1a-b0ac05a87996
Jul 27 12:58:22 user nova-compute[70994]: INFO nova.virt.block_device [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Attempting to driver detach volume b99867ed-76c5-4c1d-ae1a-b0ac05a87996 from mountpoint /dev/vdb
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Attempting to detach device vdb from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:58:22 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:22 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:58:22 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:22 user nova-compute[70994]:   <serial>b99867ed-76c5-4c1d-ae1a-b0ac05a87996</serial>
Jul 27 12:58:22 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:58:22 user nova-compute[70994]: </disk>
Jul 27 12:58:22 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:58:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully detached device vdb from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the persistent domain config.
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:58:22 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:22 user nova-compute[70994]:   <source dev="/dev/sdd"/>
Jul 27 12:58:22 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:22 user nova-compute[70994]:   <serial>b99867ed-76c5-4c1d-ae1a-b0ac05a87996</serial>
Jul 27 12:58:22 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:58:22 user nova-compute[70994]: </disk>
Jul 27 12:58:22 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462687.4506185, 3ae811b1-0975-42e0-82ab-be09c2c2ec11 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:58:22 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] VM Stopped (Lifecycle Event)
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7348a959-5467-4dab-93a5-d6b31496b076 None None] [instance: 3ae811b1-0975-42e0-82ab-be09c2c2ec11] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462702.881995, f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:58:22 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully detached device vdb from instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 from the live domain config.
Jul 27 12:58:22 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epfoXGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:22 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a3d69e-0a43-40ac-80d1-fcc8b02620f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:58:22 user nova-compute[70994]: No targets found.
Jul 27 12:58:22 user nova-compute[70994]: iSNS:
Jul 27 12:58:22 user nova-compute[70994]: No targets found.
Jul 27 12:58:22 user nova-compute[70994]: STATIC:
Jul 27 12:58:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2
Jul 27 12:58:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996
Jul 27 12:58:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:22 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:58:22 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:22 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:22 user nova-compute[70994]: FIRMWARE:
Jul 27 12:58:22 user nova-compute[70994]: No targets found.
Jul 27 12:58:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:58:22 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:58:22 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a7f5bf-4778-4a40-982c-4010e4e433dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad67b01-db8e-4204-baa8-7376649a4750]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:22 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:22 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:22 user nova-compute[70994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 (non-flash)
Jul 27 12:58:22 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:22 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f410cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996'): ({'sdd'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Removing single pathed devices sdd {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c5a921-5419-4f5c-a421-6fda203d1830]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:22 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a1940-49cf-4e37-b44e-06d29647ede0]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Flushing IO for device /dev/sdd {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d20931-6bdd-48ce-8378-3025f7210a5a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b3c441-9cdc-4498-a8ee-486b2dc1cdc6]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] SCSI volumes sdd have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[33192cb6-3f51-41d7-b6a1-72fc5674c972]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[974567a0-1f56-4dd0-bee5-051bf2107308]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260]
Jul 27 12:58:23 user nova-compute[70994]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996, portal: 172.16.0.220,3260] successful.
Jul 27 12:58:23 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99867ed-76c5-4c1d-ae1a-b0ac05a87996 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c15ef-1543-4cae-87bd-fb2e39d9345e]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] <== disconnect_volume: return (306ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:58:23 user nova-compute[70994]: DEBUG nova.objects.instance [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'flavor' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:24 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-56adab3f-8e54-44a3-845d-f88500758921 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.676s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:27 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:32 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:37 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:41 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:42 user nova-compute[70994]: INFO nova.compute.manager [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Detaching volume 0385bd3d-c8d3-42da-bf00-de3a3e082ed2
Jul 27 12:58:42 user nova-compute[70994]: INFO nova.virt.block_device [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Attempting to driver detach volume 0385bd3d-c8d3-42da-bf00-de3a3e082ed2 from mountpoint /dev/vdb
Jul 27 12:58:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Attempting to detach device vdb from instance f8484a0e-283c-4da4-98f3-788038c26d2b from the persistent domain config. {{(pid=70994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:58:42 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:42 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:58:42 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:42 user nova-compute[70994]:   <serial>0385bd3d-c8d3-42da-bf00-de3a3e082ed2</serial>
Jul 27 12:58:42 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:58:42 user nova-compute[70994]: </disk>
Jul 27 12:58:42 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:58:42 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully detached device vdb from instance f8484a0e-283c-4da4-98f3-788038c26d2b from the persistent domain config.
Jul 27 12:58:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8484a0e-283c-4da4-98f3-788038c26d2b from the live domain config. {{(pid=70994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 12:58:42 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:42 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:58:42 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:42 user nova-compute[70994]:   <serial>0385bd3d-c8d3-42da-bf00-de3a3e082ed2</serial>
Jul 27 12:58:42 user nova-compute[70994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 12:58:42 user nova-compute[70994]: </disk>
Jul 27 12:58:42 user nova-compute[70994]:  {{(pid=70994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 12:58:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Received event <DeviceRemovedEvent: 1690462723.1071498, f8484a0e-283c-4da4-98f3-788038c26d2b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70994) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 12:58:43 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully detached device vdb from instance f8484a0e-283c-4da4-98f3-788038c26d2b from the live domain config.
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPHcFrVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:43 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5381a6f7-6e32-4406-ba66-2f6d5bd04460]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:58:43 user nova-compute[70994]: No targets found.
Jul 27 12:58:43 user nova-compute[70994]: iSNS:
Jul 27 12:58:43 user nova-compute[70994]: No targets found.
Jul 27 12:58:43 user nova-compute[70994]: STATIC:
Jul 27 12:58:43 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2
Jul 27 12:58:43 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:43 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:43 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:58:43 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:43 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:43 user nova-compute[70994]: FIRMWARE:
Jul 27 12:58:43 user nova-compute[70994]: No targets found.
Jul 27 12:58:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:58:43 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:58:43 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761acbd-edad-43c7-8a15-95783774ba5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472f3b6-1a6e-4b63-864b-5488a331750a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:43 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:43 user nova-compute[70994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 (non-flash)
Jul 27 12:58:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4316560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2'): ({'sdb'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Removing single pathed devices sdb {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ad091-c86e-489b-aaaa-d2d30445eb04]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e01b0-6135-4001-b271-0c11f505f128]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Flushing IO for device /dev/sdb {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a9922b-8403-4652-9bcd-566d8a6e58f8]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquired lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Forcefully refreshing network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bde7426-f79b-4a4b-b293-ad095fcaf18d]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] SCSI volumes sdb have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d94a6-8d80-4999-88ec-0836b08adf1a]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2f3ee-90c7-47a4-980e-8a59951c2697]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260]
Jul 27 12:58:43 user nova-compute[70994]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2, portal: 172.16.0.220,3260] successful.
Jul 27 12:58:43 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9806a-8057-4b51-a532-9174c7b9dbf9]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== disconnect_volume: return (309ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updating instance_info_cache with network_info: [{"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Releasing lock "refresh_cache-1233d1bf-9c86-45fb-8ed6-bd15064226d3" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:58:43 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updated the network info_cache for instance {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.objects.instance [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'flavor' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-0b12cbd2-c247-43af-bb00-0e1cd67ac04c tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: INFO nova.compute.manager [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Terminating instance
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.596s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:58:44 user nova-compute[70994]: INFO nova.compute.manager [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Terminating instance
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-unplugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] No waiting events found dispatching network-vif-unplugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-ce9fda0b-d854-4448-8167-95ad690d5b8a req-1bc5b2b9-3b14-4fd0-89d2-241ef3e5531d service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-unplugged-240463f9-7ebb-4f8e-a570-4089967326f2 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9366ce3e-290d-4005-877a-9b4b28af9c59 req-8d03551e-c71b-40f5-a9a4-9071e52b44b5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] Instance destroyed successfully.
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'resources' on Instance uuid 1972c076-947c-4b1e-96bd-098922378366 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Instance destroyed successfully.
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.objects.instance [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lazy-loading 'resources' on Instance uuid f8484a0e-283c-4da4-98f3-788038c26d2b {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1104644606',display_name='tempest-VolumesSnapshotTestJSON-instance-1104644606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1104644606',id=35,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPeJPHQK9Sh6DRzqENmZtx3qjEjOhLeLVIkUWlXAxQzVyDiMgQuic5fioQar947hqgPq0Y6pTR9krmPhmhEkf1Bet7PKACSi9bYUnlI/UWi35BuNCPJvw0I/WJobf9HRg==',key_name='tempest-keypair-321677142',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4488876cea8e410c9822a55b04cffc8c',ramdisk_id='',reservation_id='r-ryo046it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-472536409',owner_user_name='tempest-VolumesSnapshotTestJSON-472536409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db8e13665d53464d9e601434a0cbce1d',uuid=f8484a0e-283c-4da4-98f3-788038c26d2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converting VIF {"id": "ac6efe9e-c805-46d6-869c-67602dc3400d", "address": "fa:16:3e:14:76:4a", "network": {"id": "85de138b-384d-488f-9d2c-9bd292fff3de", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2026165138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4488876cea8e410c9822a55b04cffc8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac6efe9e-c8", "ovs_interfaceid": "ac6efe9e-c805-46d6-869c-67602dc3400d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_vif [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1731753672',display_name='tempest-AttachVolumeNegativeTest-server-1731753672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1731753672',id=34,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJBlgt6DJVlBcHlvkIQb2eZHo70vGVXPtZv5zzBV/yIE5IqFPADak6S8M3gEdrh1j+stg/IhLruKUsPfacZPMDzNzF951ETAVdPW5zdCAW/RyiBNPAxRIyoFYVEcD4hdg==',key_name='tempest-keypair-1463066970',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-c0ri608c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=1972c076-947c-4b1e-96bd-098922378366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "240463f9-7ebb-4f8e-a570-4089967326f2", "address": "fa:16:3e:37:f1:93", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap240463f9-7e", "ovs_interfaceid": "240463f9-7ebb-4f8e-a570-4089967326f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_vif [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac6efe9e-c8, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap240463f9-7e, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:45 user nova-compute[70994]: INFO os_vif [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:76:4a,bridge_name='br-int',has_traffic_filtering=True,id=ac6efe9e-c805-46d6-869c-67602dc3400d,network=Network(85de138b-384d-488f-9d2c-9bd292fff3de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac6efe9e-c8')
Jul 27 12:58:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPHcFrVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:45 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:45 user nova-compute[70994]: INFO os_vif [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:f1:93,bridge_name='br-int',has_traffic_filtering=True,id=240463f9-7ebb-4f8e-a570-4089967326f2,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap240463f9-7e')
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Deleting instance files /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366_del
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Deletion of /opt/stack/data/nova/instances/1972c076-947c-4b1e-96bd-098922378366_del complete
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8a7a4-5abf-444e-a1f6-e61e7e17f111]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:58:45 user nova-compute[70994]: No targets found.
Jul 27 12:58:45 user nova-compute[70994]: iSNS:
Jul 27 12:58:45 user nova-compute[70994]: No targets found.
Jul 27 12:58:45 user nova-compute[70994]: STATIC:
Jul 27 12:58:45 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:58:45 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:58:45 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:58:45 user nova-compute[70994]: FIRMWARE:
Jul 27 12:58:45 user nova-compute[70994]: No targets found.
Jul 27 12:58:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:58:45 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:58:45 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0385bd3d-c8d3-42da-bf00-de3a3e082ed2', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.compute.manager [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 1972c076-947c-4b1e-96bd-098922378366] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10042d5f-8701-4e6e-b023-77f8784a0ce0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb40e02-bbab-4aaf-94f6-43992edc318d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4303880>, {}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Disconnecting from: [] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.159s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] <== disconnect_volume: return (159ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Deleting instance files /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b_del
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Deletion of /opt/stack/data/nova/instances/f8484a0e-283c-4da4-98f3-788038c26d2b_del complete
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: INFO nova.compute.manager [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Took 1.44 seconds to destroy the instance on the hypervisor.
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Error from libvirt while getting description of instance-00000023: [Error Code 42] Domain not found: no domain with matching uuid 'f8484a0e-283c-4da4-98f3-788038c26d2b' (instance-00000023): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f8484a0e-283c-4da4-98f3-788038c26d2b' (instance-00000023)
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:58:46 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid '1972c076-947c-4b1e-96bd-098922378366' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid '1972c076-947c-4b1e-96bd-098922378366' (instance-00000022)
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Acquiring lock "1972c076-947c-4b1e-96bd-098922378366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Lock "1972c076-947c-4b1e-96bd-098922378366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] No waiting events found dispatching network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:46 user nova-compute[70994]: WARNING nova.compute.manager [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received unexpected event network-vif-plugged-240463f9-7ebb-4f8e-a570-4089967326f2 for instance with vm_state active and task_state deleting.
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-changed-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Refreshing instance network info cache due to event network-changed-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Acquiring lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Acquired lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.network.neutron [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Refreshing network info cache for port c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:46 user nova-compute[70994]: WARNING nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state active and task_state deleting.
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:46 user nova-compute[70994]: WARNING nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state active and task_state deleting.
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:46 user nova-compute[70994]: WARNING nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state active and task_state deleting.
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-cd0f74e7-08db-4bf7-84d8-8a482f606a1d req-e6217b06-6d36-4a9a-b50e-a13f8b4001d5 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-unplugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-e88db56a-2a2a-4fed-83c2-6741044d501c req-cbad6405-f3eb-4aa1-a916-62e639d7cda9 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-deleted-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:47 user nova-compute[70994]: INFO nova.compute.manager [req-e88db56a-2a2a-4fed-83c2-6741044d501c req-cbad6405-f3eb-4aa1-a916-62e639d7cda9 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Neutron deleted interface ac6efe9e-c805-46d6-869c-67602dc3400d; detaching it from the instance and deleting it from the info cache
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.network.neutron [req-e88db56a-2a2a-4fed-83c2-6741044d501c req-cbad6405-f3eb-4aa1-a916-62e639d7cda9 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:58:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=25.144893646240234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:47 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Took 2.10 seconds to deallocate network for instance.
Jul 27 12:58:47 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] Took 2.26 seconds to deallocate network for instance.
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-e88db56a-2a2a-4fed-83c2-6741044d501c req-cbad6405-f3eb-4aa1-a916-62e639d7cda9 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Detach interface failed, port_id=ac6efe9e-c805-46d6-869c-67602dc3400d, reason: Instance f8484a0e-283c-4da4-98f3-788038c26d2b could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:58:47 user nova-compute[70994]: WARNING nova.volume.cinder [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Attachment 03bd0584-67ab-4d54-84d7-03297aa724b5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 03bd0584-67ab-4d54-84d7-03297aa724b5. (HTTP 404) (Request-ID: req-f69ed2a5-faf9-4d8b-b80b-bd96951961ca)
Jul 27 12:58:47 user nova-compute[70994]: INFO nova.compute.manager [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Took 0.04 seconds to detach 1 volumes for instance.
Jul 27 12:58:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 1972c076-947c-4b1e-96bd-098922378366 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance f8484a0e-283c-4da4-98f3-788038c26d2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 798b2c91-4c2f-4906-befb-c3a14e2c4efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:58:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.network.neutron [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updated VIF entry in instance network info cache for port c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.network.neutron [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updating instance_info_cache with network_info: [{"id": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "address": "fa:16:3e:51:bc:8d", "network": {"id": "6874216c-9068-413f-b901-c604061a9d89", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-330643205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b20a41397014d77b288cc6a2a97ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d38f1f-72", "ovs_interfaceid": "c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-b6a16fbe-c0bc-4550-a124-cbf12be3ed62 req-5b05557b-2a6a-4005-ae9c-5724d43f8383 service nova] Releasing lock "refresh_cache-798b2c91-4c2f-4906-befb-c3a14e2c4efa" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.301s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.526s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:48 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Deleted allocations for instance 1972c076-947c-4b1e-96bd-098922378366
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-e4c51704-7d1f-4eeb-a2aa-fad288adb666 tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "1972c076-947c-4b1e-96bd-098922378366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.333s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Deleted allocations for instance f8484a0e-283c-4da4-98f3-788038c26d2b
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-a97f9b4a-7477-455e-b180-05c71cab308e tempest-VolumesSnapshotTestJSON-472536409 tempest-VolumesSnapshotTestJSON-472536409-project-member] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.607s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] [instance: 1972c076-947c-4b1e-96bd-098922378366] Received event network-vif-deleted-240463f9-7ebb-4f8e-a570-4089967326f2 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] Acquiring lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] Lock "f8484a0e-283c-4da4-98f3-788038c26d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] No waiting events found dispatching network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:48 user nova-compute[70994]: WARNING nova.compute.manager [req-f61c1d40-06d0-44b6-81fa-613a16346a8b req-bb6a92a6-d1b9-4f11-a304-bfa85b3cac76 service nova] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Received unexpected event network-vif-plugged-ac6efe9e-c805-46d6-869c-67602dc3400d for instance with vm_state deleted and task_state None.
Jul 27 12:58:49 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:49 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:49 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 12:58:49 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] There are 0 instances to clean {{(pid=70994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG nova.objects.instance [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lazy-loading 'flavor' on Instance uuid 798b2c91-4c2f-4906-befb-c3a14e2c4efa {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:50 user nova-compute[70994]: INFO nova.compute.manager [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Attaching volume 137666e6-66fd-4a9a-ba01-1827c06fc8c7 to /dev/vdb
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.utils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b1418-1ead-472a-bc2a-bca75bb279a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19725c3c28b9\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681c05e-4e8d-4f44-ae27-9d14e08edc4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af7fa0-50c2-46ce-9103-6342c476d525]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a86570-9750-447c-aa43-f772be00d9aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Running cmd (subprocess): nvme version {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] 'nvme version' failed. Not Retrying. {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] nvme not present on system {{(pid=70994) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 12:58:50 user nova-compute[70994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 12:58:50 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5db30-25b0-4446-a751-b99b92e74c1d]: (4, '') {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70994) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.lightos [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] LIGHTOS: no hostnqn found. {{(pid=70994) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG os_brick.utils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19725c3c28b9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:50 user nova-compute[70994]: DEBUG nova.virt.block_device [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Updating existing volume attachment record: 0d0a62a9-b844-456c-91b0-de8183490b65 {{(pid=70994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:53 user nova-compute[70994]: INFO nova.compute.manager [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Terminating instance
Jul 27 12:58:53 user nova-compute[70994]: DEBUG nova.compute.manager [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-unplugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] No waiting events found dispatching network-vif-unplugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG nova.compute.manager [req-ed49fdc9-ef29-4780-b3a3-482f2ac53479 req-7665681f-84dc-4c66-b40b-be1cf557da87 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-unplugged-8b853aae-ac89-4593-8b6c-8787ae70341d for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:58:53 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Instance destroyed successfully.
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.objects.instance [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid 1233d1bf-9c86-45fb-8ed6-bd15064226d3 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:48:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-723803136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-723803136',id=26,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-88xk52bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:50:38Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=1233d1bf-9c86-45fb-8ed6-bd15064226d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "8b853aae-ac89-4593-8b6c-8787ae70341d", "address": "fa:16:3e:38:0e:fd", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853aae-ac", "ovs_interfaceid": "8b853aae-ac89-4593-8b6c-8787ae70341d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG os_vif [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b853aae-ac, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:58:54 user nova-compute[70994]: INFO os_vif [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0e:fd,bridge_name='br-int',has_traffic_filtering=True,id=8b853aae-ac89-4593-8b6c-8787ae70341d,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853aae-ac')
Jul 27 12:58:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Deleting instance files /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3_del
Jul 27 12:58:54 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Deletion of /opt/stack/data/nova/instances/1233d1bf-9c86-45fb-8ed6-bd15064226d3_del complete
Jul 27 12:58:54 user nova-compute[70994]: INFO nova.compute.manager [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Took 0.75 seconds to destroy the instance on the hypervisor.
Jul 27 12:58:54 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:58:54 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-ff1d603d-4cf6-4ec9-acb9-6f57754eef3a req-7e6e04d6-787c-426d-a481-42dfed7013d4 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-deleted-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:55 user nova-compute[70994]: INFO nova.compute.manager [req-ff1d603d-4cf6-4ec9-acb9-6f57754eef3a req-7e6e04d6-787c-426d-a481-42dfed7013d4 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Neutron deleted interface 8b853aae-ac89-4593-8b6c-8787ae70341d; detaching it from the instance and deleting it from the info cache
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.network.neutron [req-ff1d603d-4cf6-4ec9-acb9-6f57754eef3a req-7e6e04d6-787c-426d-a481-42dfed7013d4 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:58:55 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Took 1.03 seconds to deallocate network for instance.
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-ff1d603d-4cf6-4ec9-acb9-6f57754eef3a req-7e6e04d6-787c-426d-a481-42dfed7013d4 service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Detach interface failed, port_id=8b853aae-ac89-4593-8b6c-8787ae70341d, reason: Instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:55 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Deleted allocations for instance 1233d1bf-9c86-45fb-8ed6-bd15064226d3
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-257f62fc-ceee-46f6-a1f4-50b9dbbc6d3d tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] Acquiring lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] Lock "1233d1bf-9c86-45fb-8ed6-bd15064226d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:58:55 user nova-compute[70994]: DEBUG nova.compute.manager [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] No waiting events found dispatching network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:58:55 user nova-compute[70994]: WARNING nova.compute.manager [req-ea0bc33f-4845-45ee-942d-94b5ab5814aa req-d11194ec-d1ca-4a7f-8f76-cf3ecadd6a6c service nova] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Received unexpected event network-vif-plugged-8b853aae-ac89-4593-8b6c-8787ae70341d for instance with vm_state deleted and task_state None.
Jul 27 12:58:57 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Calling os-brick to attach iSCSI Volume {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCOafGJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:58:57 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:57 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:58:57 user nova-compute[70994]: INFO os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5469d-a7cf-4863-a550-5153ff7782f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 12:58:57 user nova-compute[70994]:  {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[559dd0c7-7420-4380-90bc-bdcecbf2f7c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7] added\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7] added
Jul 27 12:58:57 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa56783c-4147-40d2-a829-c5a9f38de097]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[334541c7-6ce5-4362-98a3-b1476518922f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCOafGJq {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCOafGJq" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a569f585-60b4-44a5-8873-d49103adb179]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCOafGJq'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c4476-5543-4f75-9025-0c3b0af72b61]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:57 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ccc16-4a2e-4c4f-89e9-bc03102ddd2a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --login {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27f802-2c7b-46da-bdb9-014dfb8e7b17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7, portal: 172.16.0.220,3260]
Jul 27 12:58:58 user nova-compute[70994]: Login to [iface: default, target: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7, portal: 172.16.0.220,3260] successful.
Jul 27 12:58:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1edd03f-c3a3-4179-9eb1-89232cf8460f]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7dc3cc-3d2b-4c3c-982e-8f5f681f4287]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:58 user nova-compute[70994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)
Jul 27 12:58:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:58:58 user nova-compute[70994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)
Jul 27 12:58:58 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Connected to 172.16.0.220:3260 {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=70994) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70994) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b320dcb-d616-4f2c-86ac-2e6d49dcd062]: (4, ('- - 0', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70994) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 12:58:58 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCOafGJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70994) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23061316164323162', 'path': '/dev/sdb'} {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061316164323162', 'path': '/dev/sdb'} {{(pid=70994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.objects.instance [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lazy-loading 'flavor' on Instance uuid 798b2c91-4c2f-4906-befb-c3a14e2c4efa {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.guest [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 12:58:59 user nova-compute[70994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 12:58:59 user nova-compute[70994]:   <source dev="/dev/sdb"/>
Jul 27 12:58:59 user nova-compute[70994]:   <target dev="vdb" bus="virtio"/>
Jul 27 12:58:59 user nova-compute[70994]:   <serial>137666e6-66fd-4a9a-ba01-1827c06fc8c7</serial>
Jul 27 12:58:59 user nova-compute[70994]: </disk>
Jul 27 12:58:59 user nova-compute[70994]:  {{(pid=70994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] No VIF found with MAC fa:16:3e:51:bc:8d, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:58:59 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-04eb4f10-d3a7-49c2-a100-27c4c7abff3a tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.338s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70994) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.objects.instance [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lazy-loading 'flavor' on Instance uuid 798b2c91-4c2f-4906-befb-c3a14e2c4efa {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462725.3858058, 1972c076-947c-4b1e-96bd-098922378366 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:00 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 1972c076-947c-4b1e-96bd-098922378366] VM Stopped (Lifecycle Event)
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462725.399064, f8484a0e-283c-4da4-98f3-788038c26d2b => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:00 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] VM Stopped (Lifecycle Event)
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-8d3b2b4d-de7b-4912-b322-62d309bab711 None None] [instance: 1972c076-947c-4b1e-96bd-098922378366] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-ec8ed3a6-b9ee-498d-a675-7ed5f2205563 None None] [instance: f8484a0e-283c-4da4-98f3-788038c26d2b] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG nova.compute.manager [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:00 user nova-compute[70994]: WARNING nova.compute.manager [req-996d5c7f-307e-4e78-b79d-d3a5e19e9e83 req-036d163a-4419-47a0-a031-886cfbbb80ea service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state active and task_state powering-off.
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Instance destroyed successfully.
Jul 27 12:59:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-57aabd8b-7931-48c0-909d-bfd651f959d0 tempest-AttachVolumeTestJSON-2073980352 tempest-AttachVolumeTestJSON-2073980352-project-member] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.902s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "3707d327-d829-4fdf-bc6c-9646a6d5e342" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:59:01 user nova-compute[70994]: INFO nova.compute.claims [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Claim successful on node user
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:59:01 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:59:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.policy [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81685771daeb49bfbe069cb849e82adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92730f3b460c4f5c816d4aaad7645039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:59:02 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Creating image(s)
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "/opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "/opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "/opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "035095f50a3aa954cd9165bcf21db93ce70087c4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "035095f50a3aa954cd9165bcf21db93ce70087c4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.part --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:02 user nova-compute[70994]: WARNING nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state stopped and task_state None.
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:02 user nova-compute[70994]: WARNING nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state stopped and task_state None.
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:02 user nova-compute[70994]: WARNING nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state stopped and task_state None.
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:02 user nova-compute[70994]: WARNING nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-unplugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state stopped and task_state None.
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Acquiring lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] Lock "798b2c91-4c2f-4906-befb-c3a14e2c4efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] No waiting events found dispatching network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:02 user nova-compute[70994]: WARNING nova.compute.manager [req-fe82fc58-e853-4f52-812e-7eb6917bb631 req-1b4750d1-6163-4d04-aff3-c5e6ec6e0de9 service nova] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Received unexpected event network-vif-plugged-c7d38f1f-7234-4caf-bfd0-c1a08a18cd4b for instance with vm_state stopped and task_state None.
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.part --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.virt.images [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba was qcow2, converting to raw {{(pid=70994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.privsep.utils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.part /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.converted {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:02 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Successfully created port: be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.part /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.converted" returned: 0 in 0.364s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.converted --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "035095f50a3aa954cd9165bcf21db93ce70087c4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.191s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "035095f50a3aa954cd9165bcf21db93ce70087c4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "035095f50a3aa954cd9165bcf21db93ce70087c4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json" returned: 0 in 0.143s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4,backing_fmt=raw /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Successfully updated port: be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4,backing_fmt=raw /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk 1073741824" returned: 0 in 0.063s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "035095f50a3aa954cd9165bcf21db93ce70087c4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquired lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Received event network-changed-be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.compute.manager [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Refreshing instance network info cache due to event network-changed-be36c3c0-0c8a-4c1c-b00f-a28c126910dd. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] Acquiring lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/035095f50a3aa954cd9165bcf21db93ce70087c4 --force-share --output=json" returned: 0 in 0.147s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:59:03 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Cannot resize image /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.objects.instance [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'migration_context' on Instance uuid 3707d327-d829-4fdf-bc6c-9646a6d5e342 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Ensure instance console log exists: /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.neutron [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Updating instance_info_cache with network_info: [{"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Releasing lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Instance network_info: |[{"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] Acquired lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Refreshing network info cache for port be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Start _get_guest_xml network_info=[{"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:58:58Z,direct_url=<?>,disk_format='qcow2',id=c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba,min_disk=0,min_ram=0,name='tempest-scenario-img--1620644752',owner='92730f3b460c4f5c816d4aaad7645039',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:59:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:59:04 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:04 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:58:58Z,direct_url=<?>,disk_format='qcow2',id=c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba,min_disk=0,min_ram=0,name='tempest-scenario-img--1620644752',owner='92730f3b460c4f5c816d4aaad7645039',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:59:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-803882554',display_name='tempest-TestMinimumBasicScenario-server-803882554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-803882554',id=37,image_ref='c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxVhH/JApqwdPkfreZct3Sgddq5k8jD4z1NwGoVNlALYPazQcJwLkYwPLRlLcpDEMXIuqhf2u+miJ3ODJ+9xn+Vz3QKpoamaJoIjtDCYbVDFO6CRzcyZwDahP5F2EeGQw==',key_name='tempest-TestMinimumBasicScenario-685099929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-r7beunzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:59:02Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3707d327-d829-4fdf-bc6c-9646a6d5e342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=be36c3c0-0c8a-4c1c-b00f-a28c126910dd,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c3c0-0c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.objects.instance [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lazy-loading 'pci_devices' on Instance uuid 3707d327-d829-4fdf-bc6c-9646a6d5e342 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:59:04 user nova-compute[70994]:   <uuid>3707d327-d829-4fdf-bc6c-9646a6d5e342</uuid>
Jul 27 12:59:04 user nova-compute[70994]:   <name>instance-00000025</name>
Jul 27 12:59:04 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:59:04 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:59:04 user nova-compute[70994]:   <metadata>
Jul 27 12:59:04 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:59:04 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:name>tempest-TestMinimumBasicScenario-server-803882554</nova:name>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:59:04</nova:creationTime>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:59:04 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:59:04 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:owner>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:user uuid="81685771daeb49bfbe069cb849e82adf">tempest-TestMinimumBasicScenario-312128031-project-member</nova:user>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:project uuid="92730f3b460c4f5c816d4aaad7645039">tempest-TestMinimumBasicScenario-312128031</nova:project>
Jul 27 12:59:04 user nova-compute[70994]:       </nova:owner>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:root type="image" uuid="c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba"/>
Jul 27 12:59:04 user nova-compute[70994]:       <nova:ports>
Jul 27 12:59:04 user nova-compute[70994]:         <nova:port uuid="be36c3c0-0c8a-4c1c-b00f-a28c126910dd">
Jul 27 12:59:04 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 12:59:04 user nova-compute[70994]:         </nova:port>
Jul 27 12:59:04 user nova-compute[70994]:       </nova:ports>
Jul 27 12:59:04 user nova-compute[70994]:     </nova:instance>
Jul 27 12:59:04 user nova-compute[70994]:   </metadata>
Jul 27 12:59:04 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:59:04 user nova-compute[70994]:     <system>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="serial">3707d327-d829-4fdf-bc6c-9646a6d5e342</entry>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="uuid">3707d327-d829-4fdf-bc6c-9646a6d5e342</entry>
Jul 27 12:59:04 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:59:04 user nova-compute[70994]:     </system>
Jul 27 12:59:04 user nova-compute[70994]:   </sysinfo>
Jul 27 12:59:04 user nova-compute[70994]:   <os>
Jul 27 12:59:04 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:59:04 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:59:04 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:59:04 user nova-compute[70994]:   </os>
Jul 27 12:59:04 user nova-compute[70994]:   <features>
Jul 27 12:59:04 user nova-compute[70994]:     <acpi/>
Jul 27 12:59:04 user nova-compute[70994]:     <apic/>
Jul 27 12:59:04 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:59:04 user nova-compute[70994]:   </features>
Jul 27 12:59:04 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:59:04 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:59:04 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:59:04 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:59:04 user nova-compute[70994]:   </clock>
Jul 27 12:59:04 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:59:04 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:59:04 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:59:04 user nova-compute[70994]:   </cpu>
Jul 27 12:59:04 user nova-compute[70994]:   <devices>
Jul 27 12:59:04 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:59:04 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:59:04 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk"/>
Jul 27 12:59:04 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:59:04 user nova-compute[70994]:     </disk>
Jul 27 12:59:04 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:59:04 user nova-compute[70994]:       <mac address="fa:16:3e:04:14:7c"/>
Jul 27 12:59:04 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:59:04 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:59:04 user nova-compute[70994]:       <target dev="tapbe36c3c0-0c"/>
Jul 27 12:59:04 user nova-compute[70994]:     </interface>
Jul 27 12:59:04 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:59:04 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/console.log" append="off"/>
Jul 27 12:59:04 user nova-compute[70994]:     </serial>
Jul 27 12:59:04 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:59:04 user nova-compute[70994]:     <video>
Jul 27 12:59:04 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:59:04 user nova-compute[70994]:     </video>
Jul 27 12:59:04 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:59:04 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:59:04 user nova-compute[70994]:     </rng>
Jul 27 12:59:04 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:59:04 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:59:04 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:59:04 user nova-compute[70994]:     </memballoon>
Jul 27 12:59:04 user nova-compute[70994]:   </devices>
Jul 27 12:59:04 user nova-compute[70994]: </domain>
Jul 27 12:59:04 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-803882554',display_name='tempest-TestMinimumBasicScenario-server-803882554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-803882554',id=37,image_ref='c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxVhH/JApqwdPkfreZct3Sgddq5k8jD4z1NwGoVNlALYPazQcJwLkYwPLRlLcpDEMXIuqhf2u+miJ3ODJ+9xn+Vz3QKpoamaJoIjtDCYbVDFO6CRzcyZwDahP5F2EeGQw==',key_name='tempest-TestMinimumBasicScenario-685099929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92730f3b460c4f5c816d4aaad7645039',ramdisk_id='',reservation_id='r-r7beunzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c0da0c17-5b53-4a21-9dc4-fee3bc0c9eba',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-312128031',owner_user_name='tempest-TestMinimumBasicScenario-312128031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:59:02Z,user_data=None,user_id='81685771daeb49bfbe069cb849e82adf',uuid=3707d327-d829-4fdf-bc6c-9646a6d5e342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converting VIF {"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=be36c3c0-0c8a-4c1c-b00f-a28c126910dd,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c3c0-0c') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG os_vif [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=be36c3c0-0c8a-4c1c-b00f-a28c126910dd,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c3c0-0c') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe36c3c0-0c, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe36c3c0-0c, col_values=(('external_ids', {'iface-id': 'be36c3c0-0c8a-4c1c-b00f-a28c126910dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:14:7c', 'vm-uuid': '3707d327-d829-4fdf-bc6c-9646a6d5e342'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:04 user nova-compute[70994]: INFO os_vif [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=be36c3c0-0c8a-4c1c-b00f-a28c126910dd,network=Network(c7086366-ab28-4b8e-b2aa-21b526d69447),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe36c3c0-0c')
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] No VIF found with MAC fa:16:3e:04:14:7c, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Updated VIF entry in instance network info cache for port be36c3c0-0c8a-4c1c-b00f-a28c126910dd. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG nova.network.neutron [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Updating instance_info_cache with network_info: [{"id": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "address": "fa:16:3e:04:14:7c", "network": {"id": "c7086366-ab28-4b8e-b2aa-21b526d69447", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1099425825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92730f3b460c4f5c816d4aaad7645039", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe36c3c0-0c", "ovs_interfaceid": "be36c3c0-0c8a-4c1c-b00f-a28c126910dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:04 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0a133045-d5b5-4f22-a4ef-30b5c17b44e1 req-489dea6c-8aae-49a1-8eaf-1aff90aa473b service nova] Releasing lock "refresh_cache-3707d327-d829-4fdf-bc6c-9646a6d5e342" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:59:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Received event network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] Acquiring lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG nova.compute.manager [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] No waiting events found dispatching network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:06 user nova-compute[70994]: WARNING nova.compute.manager [req-e0871e1b-af7a-4465-8153-fc7412f4a402 req-7f3d88c8-220c-4083-af10-3037e7cc4b63 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Received unexpected event network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd for instance with vm_state building and task_state spawning.
Jul 27 12:59:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:06 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462748.0096486, 3707d327-d829-4fdf-bc6c-9646a6d5e342 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] VM Resumed (Lifecycle Event)
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Instance spawned successfully.
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462748.0125782, 3707d327-d829-4fdf-bc6c-9646a6d5e342 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] VM Started (Lifecycle Event)
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Took 5.89 seconds to spawn the instance on the hypervisor.
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:59:08 user nova-compute[70994]: INFO nova.compute.manager [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Took 6.55 seconds to build instance.
Jul 27 12:59:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-486553a4-6056-4e09-9623-cc41f6e0ee73 tempest-TestMinimumBasicScenario-312128031 tempest-TestMinimumBasicScenario-312128031-project-member] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.653s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Received event network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] Acquiring lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] Lock "3707d327-d829-4fdf-bc6c-9646a6d5e342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:08 user nova-compute[70994]: DEBUG nova.compute.manager [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] No waiting events found dispatching network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:08 user nova-compute[70994]: WARNING nova.compute.manager [req-cb5d6038-af4a-4c60-87a4-edeaaedb2805 req-a7432c23-0f33-42d5-8311-df3ab58cae68 service nova] [instance: 3707d327-d829-4fdf-bc6c-9646a6d5e342] Received unexpected event network-vif-plugged-be36c3c0-0c8a-4c1c-b00f-a28c126910dd for instance with vm_state active and task_state None.
Jul 27 12:59:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:09 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462734.0898774, 1233d1bf-9c86-45fb-8ed6-bd15064226d3 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:09 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] VM Stopped (Lifecycle Event)
Jul 27 12:59:09 user nova-compute[70994]: DEBUG nova.compute.manager [None req-06429aca-f98d-4c3c-a05c-564b3626e863 None None] [instance: 1233d1bf-9c86-45fb-8ed6-bd15064226d3] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:09 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:12 user nova-compute[70994]: INFO nova.compute.manager [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Terminating instance
Jul 27 12:59:12 user nova-compute[70994]: DEBUG nova.compute.manager [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:12 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-unplugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] No waiting events found dispatching network-vif-unplugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.compute.manager [req-732af2b4-a2c2-49ac-a2fa-f5671444bfc5 req-d4379a19-96dc-4456-a484-28a359875326 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-unplugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:59:13 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Instance destroyed successfully.
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.objects.instance [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lazy-loading 'resources' on Instance uuid f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2055215645',display_name='tempest-TestServerVolumeAttachmentScenario-server-2055215645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2055215645',id=33,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL8D75iroqnJsjCO0gCUHdLtMcHF12uTmRZvv/0N18F3HRYY1HnL7C/T7QFamSRlUnBs9pxRbC7vZeyG9fYv9kePxfbP8N9vqyHfgB7e6XloUEIEOAHkC9LrwJp9qNKJw==',key_name='tempest-keypair-1907100483',keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='794f5aa65a2145df8ee4a41d50152d4a',ramdisk_id='',reservation_id='r-pzf8ukpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1338593503',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1338593503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c535c14a3340454fb65cce2e3e467d0d',uuid=f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converting VIF {"id": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "address": "fa:16:3e:c2:52:50", "network": {"id": "1c8fe6ce-7910-4516-94e9-b7377ed4c3b6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-855765125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "794f5aa65a2145df8ee4a41d50152d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d8eb07-38", "ovs_interfaceid": "95d8eb07-381d-4f1b-84d2-c5025edaebfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG os_vif [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95d8eb07-38, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:13 user nova-compute[70994]: INFO os_vif [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:52:50,bridge_name='br-int',has_traffic_filtering=True,id=95d8eb07-381d-4f1b-84d2-c5025edaebfc,network=Network(1c8fe6ce-7910-4516-94e9-b7377ed4c3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d8eb07-38')
Jul 27 12:59:13 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Deleting instance files /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72_del
Jul 27 12:59:13 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Deletion of /opt/stack/data/nova/instances/f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72_del complete
Jul 27 12:59:13 user nova-compute[70994]: INFO nova.compute.manager [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 27 12:59:13 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:59:13 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:14 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Took 0.98 seconds to deallocate network for instance.
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-8cbb213b-790c-4350-940a-2300457eed0e req-b228e2bc-88f5-4e75-969d-c07c38b783ac service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-deleted-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:14 user nova-compute[70994]: INFO nova.compute.manager [req-8cbb213b-790c-4350-940a-2300457eed0e req-b228e2bc-88f5-4e75-969d-c07c38b783ac service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Neutron deleted interface 95d8eb07-381d-4f1b-84d2-c5025edaebfc; detaching it from the instance and deleting it from the info cache
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.network.neutron [req-8cbb213b-790c-4350-940a-2300457eed0e req-b228e2bc-88f5-4e75-969d-c07c38b783ac service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.compute.manager [req-8cbb213b-790c-4350-940a-2300457eed0e req-b228e2bc-88f5-4e75-969d-c07c38b783ac service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Detach interface failed, port_id=95d8eb07-381d-4f1b-84d2-c5025edaebfc, reason: Instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:59:14 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:15 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Deleted allocations for instance f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72
Jul 27 12:59:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-707ddc94-09d0-4fe8-951d-1de44ca2ed47 tempest-TestServerVolumeAttachmentScenario-1338593503 tempest-TestServerVolumeAttachmentScenario-1338593503-project-member] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] Acquiring lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:15 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] Lock "f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:15 user nova-compute[70994]: DEBUG nova.compute.manager [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] No waiting events found dispatching network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:15 user nova-compute[70994]: WARNING nova.compute.manager [req-73f3af8b-e584-421b-8676-01766a9413b0 req-b284292c-d74a-4bd9-9565-c312d92c3c37 service nova] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Received unexpected event network-vif-plugged-95d8eb07-381d-4f1b-84d2-c5025edaebfc for instance with vm_state deleted and task_state None.
Jul 27 12:59:16 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462741.0516675, 798b2c91-4c2f-4906-befb-c3a14e2c4efa => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:16 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] VM Stopped (Lifecycle Event)
Jul 27 12:59:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-cc71a707-af87-4265-ab8b-fee1815dd004 None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:16 user nova-compute[70994]: DEBUG nova.compute.manager [None req-cc71a707-af87-4265-ab8b-fee1815dd004 None None] [instance: 798b2c91-4c2f-4906-befb-c3a14e2c4efa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:59:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:23 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:28 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462753.586759, f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:28 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] VM Stopped (Lifecycle Event)
Jul 27 12:59:28 user nova-compute[70994]: DEBUG nova.compute.manager [None req-b680fa09-8231-4c4e-815d-1f405a70a607 None None] [instance: f9fd78f1-f1ed-4e61-8268-18bcb1d4ba72] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Starting instance... {{(pid=70994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 12:59:39 user nova-compute[70994]: INFO nova.compute.claims [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Claim successful on node user
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Start building networks asynchronously for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Allocating IP information in the background. {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] allocate_for_instance() {{(pid=70994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 12:59:39 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Start building block device mappings for instance. {{(pid=70994) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Start spawning the instance on the hypervisor. {{(pid=70994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Creating instance directory {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 12:59:39 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Creating image(s)
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "/opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "/opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG nova.policy [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f01edb66ab454f91812588fe77761874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b620a0246ab1483d95c9f00fe7911b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70994) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.150s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:39 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.158s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk 1073741824 {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9,backing_fmt=raw /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk 1073741824" returned: 0 in 0.070s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "aab2bc35965444a55ffbd5babb0fd62168fb18a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2bc35965444a55ffbd5babb0fd62168fb18a9 --force-share --output=json" returned: 0 in 0.156s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk. size=1073741824 {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.virt.disk.api [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Cannot resize image /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk to a smaller size. {{(pid=70994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'migration_context' on Instance uuid 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Created local disks {{(pid=70994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Ensure instance console log exists: /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/console.log {{(pid=70994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:40 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Successfully created port: e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Successfully updated port: e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquiring lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Acquired lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Building network info cache for instance {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Received event network-changed-e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG nova.compute.manager [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Refreshing instance network info cache due to event network-changed-e1468fc7-1d96-41d4-b517-401c9c54b418. {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] Acquiring lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 12:59:41 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Instance cache missing network info. {{(pid=70994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.neutron [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Updating instance_info_cache with network_info: [{"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Releasing lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Instance network_info: |[{"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] Acquired lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Refreshing network info cache for port e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Start _get_guest_xml network_info=[{"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '52d4c2ab-cf6e-46c3-b167-9a89ce78020a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:42 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller missing on host. {{(pid=70994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.host [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU controller found on host. {{(pid=70994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T12:33:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T12:35:23Z,direct_url=<?>,disk_format='qcow2',id=52d4c2ab-cf6e-46c3-b167-9a89ce78020a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e7fd047385e9404eb8feada8b898a186',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T12:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image limits 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Flavor pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Image pref 0:0:0 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Got 1 possible topologies {{(pid=70994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.hardware [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-95136199',display_name='tempest-AttachVolumeNegativeTest-server-95136199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-95136199',id=38,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5vzK7slkfvZA052R+H/0HUmmTUelvtkxPJaAYYslbceFcP2iyUT1Amns5wcyetq1lL5irQKku7885s1pVmjvR4Rs7KDqxgtIR9ZVS0dkjoF/zs0l7TpBNyI0V51uGtTg==',key_name='tempest-keypair-413672079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-0s0shz9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=88b0edcd-0000-4ec7-b5d9-a0e89c7000c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e3:ba,bridge_name='br-int',has_traffic_filtering=True,id=e1468fc7-1d96-41d4-b517-401c9c54b418,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1468fc7-1d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.objects.instance [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lazy-loading 'pci_devices' on Instance uuid 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 12:59:42 user nova-compute[70994]:   <uuid>88b0edcd-0000-4ec7-b5d9-a0e89c7000c6</uuid>
Jul 27 12:59:42 user nova-compute[70994]:   <name>instance-00000026</name>
Jul 27 12:59:42 user nova-compute[70994]:   <memory>524288</memory>
Jul 27 12:59:42 user nova-compute[70994]:   <vcpu>1</vcpu>
Jul 27 12:59:42 user nova-compute[70994]:   <metadata>
Jul 27 12:59:42 user nova-compute[70994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 12:59:42 user nova-compute[70994]:       <nova:package version="0.0.0"/>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-95136199</nova:name>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:creationTime>2023-07-27 12:59:42</nova:creationTime>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:flavor name="m1.tiny">
Jul 27 12:59:42 user nova-compute[70994]:         <nova:memory>512</nova:memory>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:disk>1</nova:disk>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:swap>0</nova:swap>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:vcpus>1</nova:vcpus>
Jul 27 12:59:42 user nova-compute[70994]:       </nova:flavor>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:owner>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:user uuid="f01edb66ab454f91812588fe77761874">tempest-AttachVolumeNegativeTest-1889965975-project-member</nova:user>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:project uuid="b620a0246ab1483d95c9f00fe7911b14">tempest-AttachVolumeNegativeTest-1889965975</nova:project>
Jul 27 12:59:42 user nova-compute[70994]:       </nova:owner>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:root type="image" uuid="52d4c2ab-cf6e-46c3-b167-9a89ce78020a"/>
Jul 27 12:59:42 user nova-compute[70994]:       <nova:ports>
Jul 27 12:59:42 user nova-compute[70994]:         <nova:port uuid="e1468fc7-1d96-41d4-b517-401c9c54b418">
Jul 27 12:59:42 user nova-compute[70994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 12:59:42 user nova-compute[70994]:         </nova:port>
Jul 27 12:59:42 user nova-compute[70994]:       </nova:ports>
Jul 27 12:59:42 user nova-compute[70994]:     </nova:instance>
Jul 27 12:59:42 user nova-compute[70994]:   </metadata>
Jul 27 12:59:42 user nova-compute[70994]:   <sysinfo type="smbios">
Jul 27 12:59:42 user nova-compute[70994]:     <system>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="product">OpenStack Nova</entry>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="version">0.0.0</entry>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="serial">88b0edcd-0000-4ec7-b5d9-a0e89c7000c6</entry>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="uuid">88b0edcd-0000-4ec7-b5d9-a0e89c7000c6</entry>
Jul 27 12:59:42 user nova-compute[70994]:       <entry name="family">Virtual Machine</entry>
Jul 27 12:59:42 user nova-compute[70994]:     </system>
Jul 27 12:59:42 user nova-compute[70994]:   </sysinfo>
Jul 27 12:59:42 user nova-compute[70994]:   <os>
Jul 27 12:59:42 user nova-compute[70994]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 12:59:42 user nova-compute[70994]:     <boot dev="hd"/>
Jul 27 12:59:42 user nova-compute[70994]:     <smbios mode="sysinfo"/>
Jul 27 12:59:42 user nova-compute[70994]:   </os>
Jul 27 12:59:42 user nova-compute[70994]:   <features>
Jul 27 12:59:42 user nova-compute[70994]:     <acpi/>
Jul 27 12:59:42 user nova-compute[70994]:     <apic/>
Jul 27 12:59:42 user nova-compute[70994]:     <vmcoreinfo/>
Jul 27 12:59:42 user nova-compute[70994]:   </features>
Jul 27 12:59:42 user nova-compute[70994]:   <clock offset="utc">
Jul 27 12:59:42 user nova-compute[70994]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 12:59:42 user nova-compute[70994]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 12:59:42 user nova-compute[70994]:     <timer name="hpet" present="no"/>
Jul 27 12:59:42 user nova-compute[70994]:   </clock>
Jul 27 12:59:42 user nova-compute[70994]:   <cpu mode="custom" match="exact">
Jul 27 12:59:42 user nova-compute[70994]:     <model>Nehalem</model>
Jul 27 12:59:42 user nova-compute[70994]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 12:59:42 user nova-compute[70994]:   </cpu>
Jul 27 12:59:42 user nova-compute[70994]:   <devices>
Jul 27 12:59:42 user nova-compute[70994]:     <disk type="file" device="disk">
Jul 27 12:59:42 user nova-compute[70994]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 12:59:42 user nova-compute[70994]:       <source file="/opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk"/>
Jul 27 12:59:42 user nova-compute[70994]:       <target dev="vda" bus="virtio"/>
Jul 27 12:59:42 user nova-compute[70994]:     </disk>
Jul 27 12:59:42 user nova-compute[70994]:     <interface type="ethernet">
Jul 27 12:59:42 user nova-compute[70994]:       <mac address="fa:16:3e:68:e3:ba"/>
Jul 27 12:59:42 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:59:42 user nova-compute[70994]:       <mtu size="1442"/>
Jul 27 12:59:42 user nova-compute[70994]:       <target dev="tape1468fc7-1d"/>
Jul 27 12:59:42 user nova-compute[70994]:     </interface>
Jul 27 12:59:42 user nova-compute[70994]:     <serial type="pty">
Jul 27 12:59:42 user nova-compute[70994]:       <log file="/opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/console.log" append="off"/>
Jul 27 12:59:42 user nova-compute[70994]:     </serial>
Jul 27 12:59:42 user nova-compute[70994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 12:59:42 user nova-compute[70994]:     <video>
Jul 27 12:59:42 user nova-compute[70994]:       <model type="virtio"/>
Jul 27 12:59:42 user nova-compute[70994]:     </video>
Jul 27 12:59:42 user nova-compute[70994]:     <rng model="virtio">
Jul 27 12:59:42 user nova-compute[70994]:       <backend model="random">/dev/urandom</backend>
Jul 27 12:59:42 user nova-compute[70994]:     </rng>
Jul 27 12:59:42 user nova-compute[70994]:     <controller type="usb" index="0" model="none"/>
Jul 27 12:59:42 user nova-compute[70994]:     <memballoon model="virtio">
Jul 27 12:59:42 user nova-compute[70994]:       <stats period="10"/>
Jul 27 12:59:42 user nova-compute[70994]:     </memballoon>
Jul 27 12:59:42 user nova-compute[70994]:   </devices>
Jul 27 12:59:42 user nova-compute[70994]: </domain>
Jul 27 12:59:42 user nova-compute[70994]:  {{(pid=70994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-95136199',display_name='tempest-AttachVolumeNegativeTest-server-95136199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-95136199',id=38,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5vzK7slkfvZA052R+H/0HUmmTUelvtkxPJaAYYslbceFcP2iyUT1Amns5wcyetq1lL5irQKku7885s1pVmjvR4Rs7KDqxgtIR9ZVS0dkjoF/zs0l7TpBNyI0V51uGtTg==',key_name='tempest-keypair-413672079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b620a0246ab1483d95c9f00fe7911b14',ramdisk_id='',reservation_id='r-0s0shz9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1889965975',owner_user_name='tempest-AttachVolumeNegativeTest-1889965975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T12:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f01edb66ab454f91812588fe77761874',uuid=88b0edcd-0000-4ec7-b5d9-a0e89c7000c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converting VIF {"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e3:ba,bridge_name='br-int',has_traffic_filtering=True,id=e1468fc7-1d96-41d4-b517-401c9c54b418,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1468fc7-1d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG os_vif [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e3:ba,bridge_name='br-int',has_traffic_filtering=True,id=e1468fc7-1d96-41d4-b517-401c9c54b418,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1468fc7-1d') {{(pid=70994) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1468fc7-1d, may_exist=True, interface_attrs={}) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1468fc7-1d, col_values=(('external_ids', {'iface-id': 'e1468fc7-1d96-41d4-b517-401c9c54b418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:e3:ba', 'vm-uuid': '88b0edcd-0000-4ec7-b5d9-a0e89c7000c6'}),), if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:42 user nova-compute[70994]: INFO os_vif [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e3:ba,bridge_name='br-int',has_traffic_filtering=True,id=e1468fc7-1d96-41d4-b517-401c9c54b418,network=Network(15c519d1-380b-4c69-918d-79760090cf36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1468fc7-1d')
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No BDM found with device name vda, not building metadata. {{(pid=70994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] No VIF found with MAC fa:16:3e:68:e3:ba, not building metadata {{(pid=70994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Updated VIF entry in instance network info cache for port e1468fc7-1d96-41d4-b517-401c9c54b418. {{(pid=70994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG nova.network.neutron [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Updating instance_info_cache with network_info: [{"id": "e1468fc7-1d96-41d4-b517-401c9c54b418", "address": "fa:16:3e:68:e3:ba", "network": {"id": "15c519d1-380b-4c69-918d-79760090cf36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-646410713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b620a0246ab1483d95c9f00fe7911b14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1468fc7-1d", "ovs_interfaceid": "e1468fc7-1d96-41d4-b517-401c9c54b418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:42 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-87f5440f-009e-4c1b-8f3b-32b7ec687668 req-7dd729f2-6b9e-4aa5-bc60-419ce4e12427 service nova] Releasing lock "refresh_cache-88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" {{(pid=70994) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 12:59:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:43 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Received event network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] Acquiring lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] No waiting events found dispatching network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:44 user nova-compute[70994]: WARNING nova.compute.manager [req-fd0829a4-8921-4a21-9e1f-52f6ea49c448 req-fca8f3f3-f706-4a57-89ac-fc434bb2cddf service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Received unexpected event network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 for instance with vm_state building and task_state spawning.
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Starting heal instance info cache {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:44 user nova-compute[70994]: INFO nova.compute.manager [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Terminating instance
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Didn't find any instances for network info cache update. {{(pid=70994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.compute.manager [req-9342a779-d0c2-4a2f-a9fb-03d590c927c3 req-2ce9b8d6-bf0f-420b-831b-d5696163e2c2 service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-unplugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 12:59:44 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Instance destroyed successfully.
Jul 27 12:59:44 user nova-compute[70994]: DEBUG nova.objects.instance [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid aa5113ca-9965-4138-af35-af69b50f9500 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1262489840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1262489840',id=17,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-esrxz47u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:46:54Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=aa5113ca-9965-4138-af35-af69b50f9500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "559742f0-5d2f-414b-9963-35b75a83c42f", "address": "fa:16:3e:87:82:18", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559742f0-5d", "ovs_interfaceid": "559742f0-5d2f-414b-9963-35b75a83c42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_vif [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap559742f0-5d, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:45 user nova-compute[70994]: INFO os_vif [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:82:18,bridge_name='br-int',has_traffic_filtering=True,id=559742f0-5d2f-414b-9963-35b75a83c42f,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559742f0-5d')
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] calling os-brick to detach iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f88fc08ecb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtKAPNDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 12:59:45 user nova-compute[70994]: WARNING os_brick.initiator.connectors.base [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb36f11-2241-4fc9-af03-98dee0e764ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 12:59:45 user nova-compute[70994]: No targets found.
Jul 27 12:59:45 user nova-compute[70994]: iSNS:
Jul 27 12:59:45 user nova-compute[70994]: No targets found.
Jul 27 12:59:45 user nova-compute[70994]: STATIC:
Jul 27 12:59:45 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7
Jul 27 12:59:45 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:59:45 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:59:45 user nova-compute[70994]: Target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c
Jul 27 12:59:45 user nova-compute[70994]:         Portal: 172.16.0.220:3260,-1
Jul 27 12:59:45 user nova-compute[70994]:                 Iface Name: default
Jul 27 12:59:45 user nova-compute[70994]: FIRMWARE:
Jul 27 12:59:45 user nova-compute[70994]: No targets found.
Jul 27 12:59:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 12:59:45 user nova-compute[70994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 12:59:45 user nova-compute[70994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70994) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c', 0)] {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a15fd1-dd67-432a-b6d9-80182e63f8ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0345a7a-6787-4307-b730-e45f9471f16b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:59:45 user nova-compute[70994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)
Jul 27 12:59:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c (non-flash)
Jul 27 12:59:45 user nova-compute[70994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137666e6-66fd-4a9a-ba01-1827c06fc8c7 (non-flash)
Jul 27 12:59:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f88f4300f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c'): ({'sdc'}, set())}) {{(pid=70994) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Removing single pathed devices sdc {{(pid=70994) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[701bb70b-de4e-4811-b9e1-c7ff8495946e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=70994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e34e73-8c5e-4c88-9226-7230c4859991]: (4, ('ok\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Flushing IO for device /dev/sdc {{(pid=70994) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[871a875a-cc71-4159-9f57-9fce50a8a5ae]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70994) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8cf724-4090-4d56-beac-9e68f4fc3099]: (4, ('1', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.linuxscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] SCSI volumes sdc have been removed. {{(pid=70994) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c')] {{(pid=70994) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ff214c-f28f-4f32-a83c-bc98febf02d1]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --logout {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b077a4-95c0-41a1-a371-ab48aa9e8d3d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260]
Jul 27 12:59:45 user nova-compute[70994]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c, portal: 172.16.0.220,3260] successful.
Jul 27 12:59:45 user nova-compute[70994]:  stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op delete {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee3171b-e8ff-47d2-8f38-01742340240c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82465) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb04309-2830-4237-9446-5a82f160a33c]: (4, ('', '')) {{(pid=82465) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70994) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.base [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG os_brick.initiator.connectors.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] <== disconnect_volume: return (385ms) None {{(pid=70994) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Disconnected iSCSI Volume {{(pid=70994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 12:59:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Deleting instance files /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500_del
Jul 27 12:59:45 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Deletion of /opt/stack/data/nova/instances/aa5113ca-9965-4138-af35-af69b50f9500_del complete
Jul 27 12:59:45 user nova-compute[70994]: INFO nova.compute.manager [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88b0edcd-0000-4ec7-b5d9-a0e89c7000c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:45 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3707d327-d829-4fdf-bc6c-9646a6d5e342/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Received event network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] Acquiring lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] No waiting events found dispatching network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:46 user nova-compute[70994]: WARNING nova.compute.manager [req-d9e529ef-e642-4539-9a76-e1e5fd8e2e54 req-74a82d35-35d4-415c-983a-a0d8e5a63186 service nova] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Received unexpected event network-vif-plugged-e1468fc7-1d96-41d4-b517-401c9c54b418 for instance with vm_state building and task_state spawning.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Took 0.61 seconds to deallocate network for instance.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:46 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid 'aa5113ca-9965-4138-af35-af69b50f9500' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid 'aa5113ca-9965-4138-af35-af69b50f9500' (instance-00000011)
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462786.4632983, 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6 => Resumed> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] VM Resumed (Lifecycle Event)
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Instance event wait completed in 0 seconds for  {{(pid=70994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Guest created on hypervisor {{(pid=70994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Instance spawned successfully.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_cdrom_bus of ide {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_disk_bus of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_input_bus of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_pointer_model of None {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_video_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Found default for hw_vif_model of virtio {{(pid=70994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.driver [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] Emitting event <LifecycleEvent: 1690462786.463687, 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6 => Started> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] VM Started (Lifecycle Event)
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Took 6.82 seconds to spawn the instance on the hypervisor.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70994) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 12:59:46 user nova-compute[70994]: INFO nova.compute.manager [None req-be3976d2-4b6e-4c1c-962b-00c1d09e850d None None] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 12:59:46 user nova-compute[70994]: DEBUG oslo_concurrency.processutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798b2c91-4c2f-4906-befb-c3a14e2c4efa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70994) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 12:59:46 user nova-compute[70994]: DEBUG nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 12:59:47 user nova-compute[70994]: INFO nova.compute.manager [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Took 1.06 seconds to detach 1 volumes for instance.
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] Acquiring lock "aa5113ca-9965-4138-af35-af69b50f9500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] Lock "aa5113ca-9965-4138-af35-af69b50f9500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.manager [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] No waiting events found dispatching network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 12:59:47 user nova-compute[70994]: WARNING nova.compute.manager [req-3c39fe3e-d75e-40b9-b84e-02c17de7979a req-5e1fb59e-4cb8-4671-96f3-fe7d31c09c0d service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received unexpected event network-vif-plugged-559742f0-5d2f-414b-9963-35b75a83c42f for instance with vm_state active and task_state deleting.
Jul 27 12:59:47 user nova-compute[70994]: INFO nova.compute.manager [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] [instance: 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6] Took 8.15 seconds to build instance.
Jul 27 12:59:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:47 user nova-compute[70994]: WARNING nova.virt.libvirt.driver [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.283390045166016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dca3486b-f185-4d19-8d3a-e3bf61cca2fe tempest-AttachVolumeNegativeTest-1889965975 tempest-AttachVolumeNegativeTest-1889965975-project-member] Lock "88b0edcd-0000-4ec7-b5d9-a0e89c7000c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.253s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance aa5113ca-9965-4138-af35-af69b50f9500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 798b2c91-4c2f-4906-befb-c3a14e2c4efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 3707d327-d829-4fdf-bc6c-9646a6d5e342 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Instance 88b0edcd-0000-4ec7-b5d9-a0e89c7000c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing inventories for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating ProviderTree inventory for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Updating inventory in ProviderTree for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing aggregate associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, aggregates: None {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Refreshing trait associations for resource provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=70994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG nova.compute.resource_tracker [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Compute_service record updated for user:user {{(pid=70994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:47 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.655s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG nova.compute.manager [req-6bb0d88b-20eb-40f4-baef-b1a741b9bd5f req-cd1f9cd3-53ac-4f7d-8c4a-92cf44cfbb0a service nova] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Received event network-vif-deleted-559742f0-5d2f-414b-9963-35b75a83c42f {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:48 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Deleted allocations for instance aa5113ca-9965-4138-af35-af69b50f9500
Jul 27 12:59:48 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-51aba574-1bf4-4edc-937b-0178600a51be tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "aa5113ca-9965-4138-af35-af69b50f9500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.241s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:48 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:50 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:50 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:51 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70994) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70994) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG oslo_service.periodic_task [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70994) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 12:59:55 user nova-compute[70994]: DEBUG nova.compute.manager [None req-dd16b134-712b-47af-b6a8-b4befa2bffb9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 12:59:59 user nova-compute[70994]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690462784.984065, aa5113ca-9965-4138-af35-af69b50f9500 => Stopped> {{(pid=70994) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 12:59:59 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: aa5113ca-9965-4138-af35-af69b50f9500] VM Stopped (Lifecycle Event)
Jul 27 13:00:00 user nova-compute[70994]: DEBUG nova.compute.manager [None req-7ff3ea8b-662d-4581-9724-c5825520165c None None] [instance: aa5113ca-9965-4138-af35-af69b50f9500] Checking state {{(pid=70994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 13:00:00 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:03 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:05 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:08 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:10 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:13 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:15 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:17 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:18 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:20 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:22 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:25 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:28 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:30 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:31 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:33 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:00:35 user nova-compute[70994]: INFO nova.compute.manager [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Terminating instance
Jul 27 13:00:35 user nova-compute[70994]: DEBUG nova.compute.manager [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Start destroying the instance on the hypervisor. {{(pid=70994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-unplugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] No waiting events found dispatching network-vif-unplugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:00:35 user nova-compute[70994]: DEBUG nova.compute.manager [req-0438b6bc-7188-486d-828e-a80b9fc009fc req-9ec5685b-d8a2-4285-920d-e9b25a174e6c service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-unplugged-f2212946-0b37-4110-8c9f-6252209e2730 for instance with task_state deleting. {{(pid=70994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Instance destroyed successfully.
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.objects.instance [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lazy-loading 'resources' on Instance uuid 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 {{(pid=70994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.virt.libvirt.vif [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T12:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1853910336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1853910336',id=5,image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T12:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3cd4ff8af2445179cc6ba07c251dd4c',ramdisk_id='',reservation_id='r-mxvdwj6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='52d4c2ab-cf6e-46c3-b167-9a89ce78020a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-859808530',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T12:41:13Z,user_data=None,user_id='593a7d28021a47b491c7fa86af3edc80',uuid=52d02a1a-66ef-4b18-bd24-1326cfd1b1c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converting VIF {"id": "f2212946-0b37-4110-8c9f-6252209e2730", "address": "fa:16:3e:6f:73:dc", "network": {"id": "ebd2fb60-a472-4a04-bfb8-f4750e4f340d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1893306762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3cd4ff8af2445179cc6ba07c251dd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2212946-0b", "ovs_interfaceid": "f2212946-0b37-4110-8c9f-6252209e2730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.network.os_vif_util [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b') {{(pid=70994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG os_vif [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b') {{(pid=70994) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2212946-0b, bridge=br-int, if_exists=True) {{(pid=70994) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:36 user nova-compute[70994]: INFO os_vif [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:73:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2212946-0b37-4110-8c9f-6252209e2730,network=Network(ebd2fb60-a472-4a04-bfb8-f4750e4f340d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2212946-0b')
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Deleting instance files /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0_del
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.virt.libvirt.driver [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Deletion of /opt/stack/data/nova/instances/52d02a1a-66ef-4b18-bd24-1326cfd1b1c0_del complete
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.compute.manager [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 27 13:00:36 user nova-compute[70994]: DEBUG oslo.service.loopingcall [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70994) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.compute.manager [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Deallocating network for instance {{(pid=70994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] deallocate_for_instance() {{(pid=70994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.network.neutron [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.compute.manager [req-f53df85d-be93-4491-9f00-fa74d9277451 req-21b56d13-1dd1-48d3-b97a-e70dba33fd8e service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-deleted-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.compute.manager [req-f53df85d-be93-4491-9f00-fa74d9277451 req-21b56d13-1dd1-48d3-b97a-e70dba33fd8e service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Neutron deleted interface f2212946-0b37-4110-8c9f-6252209e2730; detaching it from the instance and deleting it from the info cache
Jul 27 13:00:36 user nova-compute[70994]: DEBUG nova.network.neutron [req-f53df85d-be93-4491-9f00-fa74d9277451 req-21b56d13-1dd1-48d3-b97a-e70dba33fd8e service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Updating instance_info_cache with network_info: [] {{(pid=70994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 13:00:36 user nova-compute[70994]: INFO nova.compute.manager [-] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Took 0.77 seconds to deallocate network for instance.
Jul 27 13:00:37 user nova-compute[70994]: DEBUG nova.compute.manager [req-f53df85d-be93-4491-9f00-fa74d9277451 req-21b56d13-1dd1-48d3-b97a-e70dba33fd8e service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Detach interface failed, port_id=f2212946-0b37-4110-8c9f-6252209e2730, reason: Instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0 could not be found. {{(pid=70994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG nova.compute.provider_tree [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed in ProviderTree for provider: 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 {{(pid=70994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG nova.scheduler.client.report [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Inventory has not changed for provider 171e9a47-00d8-4e90-9ceb-1b30c2928bd7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:00:37 user nova-compute[70994]: INFO nova.scheduler.client.report [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Deleted allocations for instance 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [None req-ebb121b2-0582-46f1-b44b-0d8b77c4fa0f tempest-ServerBootFromVolumeStableRescueTest-859808530 tempest-ServerBootFromVolumeStableRescueTest-859808530-project-member] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG nova.compute.manager [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] Acquiring lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG oslo_concurrency.lockutils [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] Lock "52d02a1a-66ef-4b18-bd24-1326cfd1b1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70994) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 13:00:37 user nova-compute[70994]: DEBUG nova.compute.manager [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] No waiting events found dispatching network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 {{(pid=70994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 13:00:37 user nova-compute[70994]: WARNING nova.compute.manager [req-56bc08e2-21ef-44ce-8261-6814c80ba9fd req-cbf32f51-33ea-4fe2-bc24-8c63fb3cb3fc service nova] [instance: 52d02a1a-66ef-4b18-bd24-1326cfd1b1c0] Received unexpected event network-vif-plugged-f2212946-0b37-4110-8c9f-6252209e2730 for instance with vm_state deleted and task_state None.
Jul 27 13:00:38 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 13:00:39 user nova-compute[70994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70994) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}